-- Logs begin at Wed 2022-05-25 06:38:34 UTC, end at Wed 2022-05-25 07:57:51 UTC. -- May 25 07:27:09.927109 dv-cinder-825492-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 25 07:27:09.935761 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 25 07:27:09.937810 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 07:27:09 2022] *** May 25 07:27:09.937810 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 07:27:09.937810 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 07:27:09.937810 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: nodename: dv-cinder-825492-15-iscsi May 25 07:27:09.937810 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: machine: x86_64 May 25 07:27:09.937810 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: clock source: unix May 25 07:27:09.937810 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: pcre jit disabled May 25 07:27:09.937810 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: detected number of CPU cores: 4 May 25 07:27:09.937810 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: current working directory: / May 25 07:27:09.937810 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: detected binary path: /usr/bin/uwsgi-core May 25 07:27:09.938585 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: your processes number limit is 47680 May 25 07:27:09.938585 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: your memory page size is 4096 bytes May 25 07:27:09.938585 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: detected max file descriptor number: 2048 May 25 07:27:09.938585 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: lock engine: pthread robust mutexes May 25 07:27:09.938585 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: thunder lock: enabled May 25 07:27:09.938585 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 25 07:27:09.938585 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 07:27:09.983878 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: Python main interpreter initialized at 0x55b45c18e9c0 May 25 07:27:09.983878 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: python threads support enabled May 25 07:27:09.983878 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: your server socket listen backlog is limited to 100 connections May 25 07:27:09.983878 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: your mercy for graceful operations on workers is 90 seconds May 25 07:27:09.984245 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: mapped 403077 bytes (393 KB) for 2 cores May 25 07:27:09.984335 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: *** Operational MODE: preforking *** May 25 07:27:09.984600 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: *** uWSGI is running in multiple interpreter mode *** May 25 07:27:09.984600 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: spawned uWSGI master process (pid: 103785) May 25 07:27:09.984750 dv-cinder-825492-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 25 07:27:09.986971 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: spawned uWSGI worker 1 (pid: 103786, cores: 1) May 25 07:27:09.986971 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: spawned uWSGI worker 2 (pid: 103787, cores: 1) May 25 07:27:09.986971 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 07:27:11.155113 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 07:27:11.158136 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 07:27:11.881131 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 07:27:11.881131 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: from cryptography.utils import int_from_bytes May 25 07:27:11.881571 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 07:27:11.881571 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: from cryptography.utils import int_from_bytes May 25 07:27:11.883060 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 07:27:11.883060 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: from cryptography.utils import int_from_bytes May 25 07:27:11.883397 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 07:27:11.883397 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: from cryptography.utils import int_from_bytes May 25 07:27:14.469654 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 07:27:14.470317 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 07:27:14.470413 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 07:27:14.470413 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 07:27:14.470857 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 07:27:14.470857 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 07:27:14.471002 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 07:27:14.471076 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 07:27:14.471181 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 07:27:14.471388 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.471487 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 07:27:14.471716 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.471822 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.472035 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.472140 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.472356 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.472453 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.472714 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.472804 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.473027 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.473124 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.473349 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.473436 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.473663 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.473758 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.473988 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.474087 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.474247 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.474337 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.474547 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.474646 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.474857 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.474942 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-15-iscsi {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.475178 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.475274 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-15-iscsi {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.475490 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.475848 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.476054 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.476145 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.476363 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.476460 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.476691 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.476790 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.476992 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.477131 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.477312 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.477405 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.477617 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.477807 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.478118 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.478269 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.478428 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.478558 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.478731 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.478851 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.479081 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.479379 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.479534 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.479703 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.479800 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.480007 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.480092 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.480322 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.480471 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.480665 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.480800 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.480988 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.481078 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.481295 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.481465 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.481690 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-15-iscsi {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.481782 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-15-iscsi {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.482006 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.482094 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.482317 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.482409 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.482630 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.482716 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.483037 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.483194 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.483345 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.483445 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.483652 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.483745 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.483974 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.484060 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.484292 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.484391 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.484621 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.484729 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.484946 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.485038 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.485262 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.485364 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.485574 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.485665 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.485889 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.485983 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.486187 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.486286 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.486491 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.486590 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.486795 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.486889 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.487108 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.487223 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.487408 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.487530 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.487707 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.487837 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.487955 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.488090 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.488258 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.488399 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.488599 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.488746 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.488917 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.489069 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.489232 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.489392 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.489482 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.489646 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.489734 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.489900 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.490017 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.490221 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.490321 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.490543 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.490639 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.490852 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.490950 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.491162 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.491260 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.491469 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.491556 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.491776 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.491862 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.492077 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.492179 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.492380 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.492468 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.492707 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.492805 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.493015 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.493108 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.493322 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.493415 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.493638 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.493731 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.493946 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.494033 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.494255 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.494350 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.494631 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.494740 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.494944 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.495247 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.495343 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.495509 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.495601 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.495823 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.495922 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.496167 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.496264 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.496494 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.496595 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.496810 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.496907 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.497112 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.497204 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.497413 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.497509 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.497714 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.497808 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.498030 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.498150 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.498332 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.498425 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.498634 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.498721 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.498882 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.498980 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.499180 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.499273 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.499479 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.499567 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.499787 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.499879 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.500084 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.500177 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.500387 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.500500 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.500714 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.500809 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.501012 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.501109 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.501317 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.501411 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.501616 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.501707 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.501916 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.502014 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.502218 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.502304 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.502519 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.502605 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.502823 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.502921 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.503126 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.503212 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.503425 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.503509 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.503731 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.503829 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.504039 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.504131 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.504345 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.504431 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.504673 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.504773 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.504979 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.505074 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.505281 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.505380 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.505583 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.505682 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.505888 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.505980 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.506189 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.506283 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.506491 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.506590 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.506800 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.506886 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.507101 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.507193 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.507402 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.507501 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.507714 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.507800 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.508016 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.508109 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.508317 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.508415 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.508648 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.508746 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.508943 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.509029 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.509246 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.509334 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.509549 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.509641 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.509850 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.509945 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.510678 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.510779 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.511071 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.511199 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.511377 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.511510 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.511681 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.511811 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.511982 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.512121 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.512284 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.512429 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.512608 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.512761 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.512907 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.513067 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.513222 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.513372 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.513540 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.513674 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.513846 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.513996 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.514156 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.514320 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.514459 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.514629 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.514759 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.514938 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.515093 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.515245 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.515422 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.515566 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:27:14.515757 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.515904 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.516069 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.516240 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.516397 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.516607 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.516751 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.516927 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.517067 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.517264 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.517379 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.517598 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.517685 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.517923 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.518020 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.518239 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.518334 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.518552 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.518638 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.518877 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.518974 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.519186 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.519271 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.519497 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.519583 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.519804 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.519890 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.520120 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.520218 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.520436 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.520540 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.520773 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.520872 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.521080 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.521168 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.521395 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.521490 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.521713 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.521803 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.522023 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.522111 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.522327 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.522423 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.522655 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.522792 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.522977 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.523063 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.523286 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.523378 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.523609 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.523698 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.523927 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.524014 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.524237 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.524324 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.524567 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.524671 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.524878 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.524965 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.525197 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.525297 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.525504 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.525593 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.526451 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.526641 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.526736 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.526832 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.527039 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.527127 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.527348 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.527444 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.527655 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.527754 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.527963 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.528050 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.528270 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.528400 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.528627 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.528730 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.528941 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.529037 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.529252 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.529338 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.529559 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.529721 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.529874 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.529961 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.530181 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.530276 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.530486 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.530575 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.530793 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.530881 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.531094 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.531190 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.531393 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.531481 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.531695 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.531782 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.531996 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.532094 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.532294 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.532381 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.532625 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.532715 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.532935 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.533022 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.533234 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.533322 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.533549 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.533641 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.533851 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.533945 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.534163 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.534251 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.534469 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.534557 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.534774 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.534873 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.535075 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.535165 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.535382 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.535504 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.535684 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.535784 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.535985 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.536079 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.536294 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.536380 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.536627 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.536732 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.536929 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.537016 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.537245 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.537333 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.537545 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.537632 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.537844 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.537930 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.538153 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.538241 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.538455 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.538541 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.538757 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.538849 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.539063 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.539368 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.539467 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.539678 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.539765 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.539983 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.540068 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.540291 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.540377 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.540641 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.540731 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.540960 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.541058 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.541260 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.541346 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.541606 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.541732 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.541946 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.542200 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.542291 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.542513 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.542608 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.542816 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.542910 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.543115 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.543210 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.543415 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.543503 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.543714 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.543801 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.544021 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.544117 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.544321 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.544407 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.544646 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.544752 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.544948 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.545085 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.545248 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.545347 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.545548 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.545643 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.545854 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.545942 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.546155 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.546242 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.546453 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.546548 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.546755 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.546850 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.547053 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.547140 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.547368 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.547462 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.547678 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.547811 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.547986 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.548074 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.548289 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.548377 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.548654 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.548756 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.548962 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.549053 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.549268 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.549356 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.549580 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.549667 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.549887 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.549974 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.550195 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.550291 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.550502 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.550589 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.550807 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.550894 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.551122 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.551217 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.551430 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.551525 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.551738 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.551833 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.552041 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.552135 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.552358 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.552443 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.552687 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.552787 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.553001 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.553088 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.553301 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.553395 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.553617 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.553760 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.553925 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.554053 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.554245 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.554366 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.554551 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.554683 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.554868 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.554982 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.555168 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.555288 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.555483 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.555608 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.555788 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.555908 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.556098 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.556224 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.556402 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.556553 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.556732 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.556862 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.557074 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.557203 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.557427 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.557535 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.557697 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.557792 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.558003 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.558090 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.558320 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.558410 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.558626 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.558714 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.558942 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.559028 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.559242 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.559330 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.559554 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.559642 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.559876 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.559964 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.560196 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.560295 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.560514 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.560684 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.560825 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.561006 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.561140 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.561335 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.561445 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.561669 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.561757 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.561982 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.562112 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.562297 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.562396 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.562609 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.562749 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.562912 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.563001 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.563220 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.563314 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.563523 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.563627 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.563827 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.563915 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.564129 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.564214 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.564435 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.564574 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.564762 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.564851 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.565062 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.565156 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.565361 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.565466 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.565666 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.565753 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.565980 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.566067 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.566285 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.566378 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.566591 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.566678 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.566896 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.566982 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.567193 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.567287 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.567493 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.567593 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.567809 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.567904 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.568111 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.568205 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.568411 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.568517 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.568740 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.568828 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.569039 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.569128 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.569360 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.569453 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.569666 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.569759 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.569963 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.570058 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.570266 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.570351 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.570571 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.570670 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.570872 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.570960 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.571182 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.571269 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.571486 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.571581 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.571789 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.571876 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.572103 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.572190 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.572409 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.572553 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.573300 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.573396 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.573560 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.573833 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.573922 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.574157 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.574244 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.574461 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.574549 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.574784 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.574871 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.575090 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.575191 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.575395 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.575483 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.575699 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.575799 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.575998 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.576088 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.576301 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.576397 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.576636 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.576738 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.576948 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.577205 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.577300 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.577534 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.577621 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.577846 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.577932 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.578160 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.578247 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.578473 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.578559 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.578788 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.579033 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.579120 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.579368 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.579463 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.579685 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.579772 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.580005 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.580101 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.580324 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.580411 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.580655 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.580820 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.580937 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.581045 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.581249 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.581367 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.581552 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.581679 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.581854 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.581982 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.582155 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.582271 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.582460 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.582575 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.582757 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.582868 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.583045 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.583160 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.583344 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.583458 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.583643 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.583759 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.583952 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.584079 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.584253 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.584367 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.584587 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.584722 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.584891 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.585005 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.585190 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.585303 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.585494 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.585610 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.585793 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.585905 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.586091 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.586227 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.586390 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.586479 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.586690 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.586784 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.587009 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.587104 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.587340 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.587435 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.587663 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.587755 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.587986 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.588080 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.588308 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.588907 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.589283 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.589398 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.589617 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.589785 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.589904 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.590019 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.590209 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.590325 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.590513 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.590628 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.590820 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.590934 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.591124 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.591245 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.591425 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.591540 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.591732 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.591859 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.592036 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.592150 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.592342 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.592464 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.592671 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.592797 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.592974 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.593088 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.593280 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.593403 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.594037 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.594124 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.594215 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.594297 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.594377 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.594458 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.594537 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.594616 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.594747 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.594836 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.595052 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.595147 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.595352 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.595450 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.595647 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.595734 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.595951 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.596078 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.596250 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.596338 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.596571 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.596662 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.596881 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.596979 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.597183 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.597284 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.597481 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.597574 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.597783 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.597876 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.598082 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.598181 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.598377 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.598463 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.598692 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.598785 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.598996 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.599090 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.599295 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.599382 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.599592 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.599679 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.599895 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.599990 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.600195 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.600289 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.600813 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.600913 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.601077 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.601166 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.601393 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.601478 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.601696 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.601783 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.601995 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.602081 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.602299 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.602385 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.602598 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.602683 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.602899 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.602987 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.603199 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.603286 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.603502 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.603590 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.603801 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.603931 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.604139 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.604289 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.604437 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.604559 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.604766 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.604853 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.605065 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.605152 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.605383 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.605479 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.605685 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.605771 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.605983 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.606067 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.606284 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.606384 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.606583 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.606670 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.606884 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.606969 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.607206 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.607300 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.607513 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.607598 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.607818 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.607906 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.608131 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.608219 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.608434 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.608537 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.608767 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.608853 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.609075 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.609163 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.609384 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.609471 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.609685 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.609779 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.609995 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.610091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.610301 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.610388 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.610609 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.610704 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.610909 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.610997 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.611206 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.611292 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.611519 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.611612 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.611821 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.611910 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.612125 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.612221 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.612434 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.612577 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.612775 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.612862 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.613095 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.613183 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.613395 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.613496 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.613701 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.613788 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.614008 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.614104 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.614343 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.614447 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.614620 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.614708 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.614925 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.615012 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.615229 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.615325 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.615534 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.615622 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.615840 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.615936 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.616145 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.616270 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.616447 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.616602 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.616775 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.616864 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.617082 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.617176 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.617384 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.617470 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.617686 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.617772 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.617998 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.618092 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.618302 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.618392 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.618602 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.618689 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.618906 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.618993 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.619207 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.619294 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.619522 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.619692 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.619846 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.619934 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.620228 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.620356 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.620562 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.620706 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.620876 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.621014 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.621185 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.621315 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.621497 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.621622 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.621803 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.621928 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.622236 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.622330 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.622544 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.622638 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.622844 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.622931 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.623144 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.623237 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.623455 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.623542 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.623765 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.623851 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.624080 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.624167 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.624396 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.624498 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.624725 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.624812 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.625029 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.625143 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.625350 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.625460 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.625653 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.625771 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.625954 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.626083 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.626253 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.626379 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.626569 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.626678 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.626869 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.626988 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.627185 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.627314 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.627597 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.627684 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.627905 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.628001 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.628205 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.628301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.628551 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.628646 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.628856 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.628954 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.629180 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.629266 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.629531 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.629617 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.629848 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.629944 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.630165 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.630260 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.630466 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.630592 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.630775 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.630908 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.631080 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.631220 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.631399 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.631545 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.631717 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.631868 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.632024 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.632192 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.632332 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.632516 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.632655 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.632835 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.632974 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.633148 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.633291 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.633474 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.633599 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.633801 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.633899 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.634116 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.634311 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.634430 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.634638 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.634726 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.634946 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.635035 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.635802 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.635927 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.636180 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.636277 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.636495 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.636694 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.636810 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.637115 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.637210 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.637414 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.637501 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.637714 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.637801 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.638035 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.638123 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.638335 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.638423 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.638639 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.638735 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.638944 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.639040 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.639248 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.639344 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.639547 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.639642 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.639849 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.639948 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.640163 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.640249 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.640465 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.640626 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.640796 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.640893 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.641105 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.641193 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.641422 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.641509 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.641740 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.641839 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.642039 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.642126 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.642357 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.642444 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.642659 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.642755 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.642958 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.643045 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.643259 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.643356 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.643559 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.643647 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.643894 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.643979 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.644192 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.644277 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.644530 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.644634 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.644840 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.644926 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.645144 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.645230 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.645448 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.645537 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.645751 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.645838 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.646092 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.646179 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.646394 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.646489 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.646704 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.646789 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.647021 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.647116 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.647320 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.647419 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.647619 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.647714 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.647924 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.648025 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.648223 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.648318 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.648542 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.648631 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.648844 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.648944 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.649148 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.649235 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.649446 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.649535 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.649744 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.649832 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.650041 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.650135 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.650358 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.650446 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.650656 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.650744 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.651615 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.651706 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.651975 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.652069 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.652283 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.652372 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.652615 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.652720 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.652921 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.653009 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.653246 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.653334 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.653552 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.653639 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.653876 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.653977 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.654187 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.654275 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.654493 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.654579 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.654800 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.654896 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.655104 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.655192 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.655441 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.655535 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.655743 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.655838 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.656052 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.656139 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.656363 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.656450 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.656699 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.656797 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.657013 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.657101 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.657324 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.657411 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.657635 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.657730 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.657940 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.658028 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.658252 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.658338 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.658560 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.658646 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.658875 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.658962 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.659187 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.659409 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.659571 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.659735 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.659823 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.660048 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.660136 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.660358 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.660453 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.660694 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.660782 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.661005 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.661104 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.661313 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.661542 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.661637 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.661870 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.661957 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.662187 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.662327 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.662495 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.662589 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.662853 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.662949 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.663117 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.663219 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.663430 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.663525 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.663740 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.663828 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.664050 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.664149 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.664359 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.664515 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.664690 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.664778 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.664998 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.665086 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.665327 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.665414 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.665651 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.665739 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.665953 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.666039 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.666266 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.666362 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.666615 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.666779 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.666934 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.667147 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.667234 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.667463 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.667591 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.667774 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.667904 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.668088 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.668210 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.668403 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.668535 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.668740 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.668853 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.669049 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.669166 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.669363 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.669463 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.669677 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.669766 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.670000 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.670088 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.670332 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.670430 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.670648 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.670742 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.670954 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.671047 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.671262 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.671349 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.671572 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.671658 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.671900 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.672090 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.672233 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.672404 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.672650 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.672762 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.672968 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.673088 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.673283 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.673411 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.673598 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.673724 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.674038 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.674131 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.674363 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.674459 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.674671 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.674759 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.674975 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.675070 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.675283 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.675370 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.675595 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.675682 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.675897 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.675992 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.676215 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.676303 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.676546 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.676637 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.676851 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.676948 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.677167 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.677309 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.677472 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.677568 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.677776 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.677999 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.678088 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.678341 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.678428 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.678653 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.678748 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.678974 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.679068 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.679284 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.679369 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.679593 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.679819 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.679918 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.680168 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.680255 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.680494 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.680582 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.680812 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.680908 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.681124 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.681211 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.681429 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.681524 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.681729 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.681824 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.682060 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.682156 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.682370 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.682605 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.682693 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.682942 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.683036 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.683251 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.683351 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.683550 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.683639 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.683856 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.683950 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.684156 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.684242 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.684456 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.684613 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.684779 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.684869 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.685084 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.685189 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.685391 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.685486 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.685688 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.685782 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.685989 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.686086 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.686289 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.686385 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.686593 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.686679 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.686889 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.687026 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.687192 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.687280 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.687489 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.687584 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.687789 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.687888 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.688084 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.688171 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.688386 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.688520 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.688755 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.688853 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.689073 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.689161 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.689373 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.689507 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.689674 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.689763 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.689981 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.690075 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.690283 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.690368 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.690591 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.690677 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.690894 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.690980 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.691197 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.691285 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.691537 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.691625 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.691840 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.691934 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.692156 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.692366 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.692463 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.692719 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.692807 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.693033 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.693121 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.693359 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.693456 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.693686 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.693773 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.693987 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.694074 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.694286 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.694543 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.694630 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.694881 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.694971 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.695184 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.695279 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.695496 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.695584 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.695799 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.695889 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.696103 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.696200 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.696406 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.696527 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.696738 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.696827 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.697043 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.697132 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.697348 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.697480 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.698171 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.698302 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.698511 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.698664 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.698818 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.698988 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.699123 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.699301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.699426 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.699614 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.699733 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.699927 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.700069 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.700240 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.700382 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.700571 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.700718 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.700885 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.701029 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.701197 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.701339 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.701508 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.701646 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.701818 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.701951 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.702133 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.702256 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.702475 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.702563 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.702795 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.702889 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.703113 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.703200 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.703428 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.703516 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.703745 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.703841 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.704059 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.704154 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.704371 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.704458 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.704705 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.704806 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.705015 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.705104 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.705332 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.705420 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.705664 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.705753 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.705979 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.706073 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.706284 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.706378 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.706600 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.706689 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.706906 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.707001 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.707233 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.707320 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.707570 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.707659 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.707895 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.707983 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.708214 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.708308 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.708535 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.708636 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.708840 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.708928 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.709141 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.709242 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.709449 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.709537 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.709762 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.709849 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.710066 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.710163 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.710369 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.710458 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.710670 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.710757 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.710975 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.711064 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.711274 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.711363 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.711574 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.711674 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.711873 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.711962 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.712171 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.712266 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.712516 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.712623 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.712793 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.712883 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.713092 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.713179 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.714021 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.714124 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.714333 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.714419 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.714642 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.714728 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.714947 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.715047 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.715258 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.715345 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.715562 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.715657 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.715871 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.715967 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.716171 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.716263 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.716492 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.716583 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.716798 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.716898 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.717100 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.717191 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.717405 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.717492 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.717718 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.717814 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.718023 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.718118 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.718329 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.718416 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.718631 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.718719 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.718937 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.719022 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.719236 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.719329 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.719558 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.719645 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.719915 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.720018 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.720178 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.720266 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.720515 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.720606 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.720827 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.720915 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.721136 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.721231 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.721440 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.721527 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.721745 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.721833 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.722051 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.722151 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.722356 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.722443 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.722662 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.722748 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.722987 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.723082 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.723290 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.723379 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.723598 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.723685 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.723911 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.724016 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.724223 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.724311 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.724556 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.724656 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.724866 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.724954 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.725191 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.725277 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.725752 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.725845 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.726074 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.726164 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.726387 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.726475 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.726693 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.726780 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.726999 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.727087 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.727311 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.727402 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.727619 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.727713 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.727938 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.728023 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.728247 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.728346 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.728575 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.728682 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.728915 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.729005 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.729256 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.729422 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.729569 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.729876 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.729965 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.730189 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.730276 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.730517 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.730615 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.730844 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.730931 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.731151 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.731237 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.731457 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.731552 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.731760 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.731847 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.732002 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103787) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 07:27:14.732123 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.732435 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.732804 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.733136 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.733453 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.733765 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.734070 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:27:14.734315 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103786) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 07:27:14.790470 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO dbcounter [None req-b7e5865a-5bd4-4678-a1fe-1082c14c89a4 None None] Registered counter for database nova_api May 25 07:27:14.793483 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO dbcounter [None req-a999df19-c5b9-4882-b775-62d453464887 None None] Registered counter for database nova_api May 25 07:27:14.811558 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG oslo_db.sqlalchemy.engines [None req-b7e5865a-5bd4-4678-a1fe-1082c14c89a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 07:27:14.813193 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_db.sqlalchemy.engines [None req-a999df19-c5b9-4882-b775-62d453464887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 07:27:14.818464 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG dbcounter [-] [103787] Writer thread running {{(pid=103787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 07:27:14.819719 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writer thread running {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 07:27:14.877957 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.context [None req-a999df19-c5b9-4882-b775-62d453464887 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b54eaccb-ae13-4b47-bdce-eca4e8d593ce(cell1) {{(pid=103786) load_cells /opt/stack/nova/nova/context.py:464}} May 25 07:27:14.880218 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.context [None req-b7e5865a-5bd4-4678-a1fe-1082c14c89a4 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b54eaccb-ae13-4b47-bdce-eca4e8d593ce(cell1) {{(pid=103787) load_cells /opt/stack/nova/nova/context.py:464}} May 25 07:27:14.882086 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-a999df19-c5b9-4882-b775-62d453464887 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:27:14.883663 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-a999df19-c5b9-4882-b775-62d453464887 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:27:14.884341 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG oslo_concurrency.lockutils [None req-b7e5865a-5bd4-4678-a1fe-1082c14c89a4 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:27:14.884462 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-a999df19-c5b9-4882-b775-62d453464887 None None] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:27:14.887020 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG oslo_concurrency.lockutils [None req-b7e5865a-5bd4-4678-a1fe-1082c14c89a4 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=103787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:27:14.887130 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-a999df19-c5b9-4882-b775-62d453464887 None None] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:27:14.887826 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG oslo_concurrency.lockutils [None req-b7e5865a-5bd4-4678-a1fe-1082c14c89a4 None None] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:27:14.889127 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO dbcounter [None req-a999df19-c5b9-4882-b775-62d453464887 None None] Registered counter for database nova_cell0 May 25 07:27:14.889857 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG oslo_concurrency.lockutils [None req-b7e5865a-5bd4-4678-a1fe-1082c14c89a4 None None] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103787) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:27:14.891986 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO dbcounter [None req-b7e5865a-5bd4-4678-a1fe-1082c14c89a4 None None] Registered counter for database nova_cell0 May 25 07:27:14.893167 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO dbcounter [None req-a999df19-c5b9-4882-b775-62d453464887 None None] Registered counter for database nova_cell1 May 25 07:27:14.896152 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO dbcounter [None req-b7e5865a-5bd4-4678-a1fe-1082c14c89a4 None None] Registered counter for database nova_cell1 May 25 07:27:14.900429 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_db.sqlalchemy.engines [None req-a999df19-c5b9-4882-b775-62d453464887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 07:27:14.902887 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_db.sqlalchemy.engines [None req-a999df19-c5b9-4882-b775-62d453464887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 07:27:14.904674 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG oslo_db.sqlalchemy.engines [None req-b7e5865a-5bd4-4678-a1fe-1082c14c89a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 07:27:14.906329 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG oslo_db.sqlalchemy.engines [None req-b7e5865a-5bd4-4678-a1fe-1082c14c89a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 07:27:14.908368 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writer thread running {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 07:27:14.910419 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writer thread running {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 07:27:14.911799 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG dbcounter [-] [103787] Writer thread running {{(pid=103787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 07:27:14.917276 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG dbcounter [-] [103787] Writer thread running {{(pid=103787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 07:27:15.055944 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO dbcounter [None req-a999df19-c5b9-4882-b775-62d453464887 None None] Registered counter for database nova_cell0 May 25 07:27:15.064080 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO dbcounter [None req-b7e5865a-5bd4-4678-a1fe-1082c14c89a4 None None] Registered counter for database nova_cell0 May 25 07:27:15.065447 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_db.sqlalchemy.engines [None req-a999df19-c5b9-4882-b775-62d453464887 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103786) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 07:27:15.069774 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writer thread running {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 07:27:15.073371 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG oslo_db.sqlalchemy.engines [None req-b7e5865a-5bd4-4678-a1fe-1082c14c89a4 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103787) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 07:27:15.078061 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG dbcounter [-] [103787] Writer thread running {{(pid=103787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 07:27:15.502140 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: WARNING keystonemiddleware.auth_token [None req-a999df19-c5b9-4882-b775-62d453464887 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 07:27:15.509301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: WARNING keystonemiddleware.auth_token [None req-a999df19-c5b9-4882-b775-62d453464887 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 07:27:15.531247 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: WARNING keystonemiddleware.auth_token [None req-b7e5865a-5bd4-4678-a1fe-1082c14c89a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 07:27:15.538689 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: WARNING keystonemiddleware.auth_token [None req-b7e5865a-5bd4-4678-a1fe-1082c14c89a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 07:27:15.853752 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: WARNING keystonemiddleware.auth_token [None req-a999df19-c5b9-4882-b775-62d453464887 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 07:27:15.859887 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: WARNING keystonemiddleware.auth_token [None req-a999df19-c5b9-4882-b775-62d453464887 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 07:27:15.865116 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b45c18e9c0 pid: 103786 (default app) May 25 07:27:15.867152 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-a999df19-c5b9-4882-b775-62d453464887 None None] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:27:15.868324 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-a999df19-c5b9-4882-b775-62d453464887 None None] 10.222.0.24 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001717 May 25 07:27:15.868755 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 1/1] 10.222.0.24 () {50 vars in 788 bytes} [Wed May 25 07:27:15 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:27:15.883559 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: WARNING keystonemiddleware.auth_token [None req-b7e5865a-5bd4-4678-a1fe-1082c14c89a4 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 07:27:15.890221 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: WARNING keystonemiddleware.auth_token [None req-b7e5865a-5bd4-4678-a1fe-1082c14c89a4 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 07:27:15.895442 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b45c18e9c0 pid: 103787 (default app) May 25 07:28:36.960715 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-a999df19-c5b9-4882-b775-62d453464887 None None] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:28:36.964562 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-a999df19-c5b9-4882-b775-62d453464887 None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.003573 May 25 07:28:36.964562 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 2/2] 10.222.0.24 () {54 vars in 930 bytes} [Wed May 25 07:28:36 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:28:36.977621 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG dbcounter [-] [103787] Writing DB stats nova_api:SELECT=3 {{(pid=103787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:28:36.978744 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG dbcounter [-] [103787] Writing DB stats nova_cell0:SELECT=3 {{(pid=103787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:28:36.979736 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG dbcounter [-] [103787] Writing DB stats nova_cell1:SELECT=3 {{(pid=103787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:28:36.980784 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG dbcounter [-] [103787] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:28:37.423683 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-8fa2ffb0-42ad-4fd6-8cb5-cdc654ad0c02 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:28:37.454684 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-8fa2ffb0-42ad-4fd6-8cb5-cdc654ad0c02 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.483174 May 25 07:28:37.455424 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 1/3] 10.222.0.24 () {60 vars in 1291 bytes} [Wed May 25 07:28:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:28:39.774604 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-a999df19-c5b9-4882-b775-62d453464887 None None] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:28:39.775626 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-a999df19-c5b9-4882-b775-62d453464887 None None] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001450 May 25 07:28:39.776019 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 3/4] 10.222.0.24 () {54 vars in 930 bytes} [Wed May 25 07:28:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:28:39.838468 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-bbb2fe39-dcab-4948-a83d-036b527d46af admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "name": "cirros256", "swap": 0, "rxtx_factor": 1.0, "disk": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:28:39.857782 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 07:28:39.857782 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: warnings.warn(msg) May 25 07:28:39.964897 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-bbb2fe39-dcab-4948-a83d-036b527d46af admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.182744 May 25 07:28:39.965395 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 2/5] 10.222.0.24 () {64 vars in 1282 bytes} [Wed May 25 07:28:39 2022] POST /compute/v2.1/flavors => generated 407 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 07:28:40.187768 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-68d778ff-23ab-422b-8844-defa2f890a45 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:28:40.190350 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 07:28:40.190350 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: warnings.warn(msg) May 25 07:28:40.193222 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writing DB stats nova_api:SELECT=3 {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:28:40.194130 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writing DB stats nova_cell0:SELECT=3 {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:28:40.195814 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writing DB stats nova_cell1:SELECT=3 {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:28:40.196747 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:28:40.324563 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-68d778ff-23ab-422b-8844-defa2f890a45 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.350847 May 25 07:28:40.326113 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 4/6] 10.222.0.24 () {64 vars in 1335 bytes} [Wed May 25 07:28:39 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:28:42.615512 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-bbb2fe39-dcab-4948-a83d-036b527d46af admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:28:42.616556 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-bbb2fe39-dcab-4948-a83d-036b527d46af admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 May 25 07:28:42.616954 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 3/7] 10.222.0.24 () {54 vars in 930 bytes} [Wed May 25 07:28:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:28:42.729779 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-d9bb950a-f343-4a9c-aa50-1d175a365af4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "vcpus": 1, "swap": 0, "name": "ds512M", "os-flavor-access:is_public": true, "ram": 512, "id": "d1"}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:28:42.747365 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 07:28:42.747365 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: warnings.warn(msg) May 25 07:28:42.816106 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-d9bb950a-f343-4a9c-aa50-1d175a365af4 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.192868 May 25 07:28:42.816599 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 5/8] 10.222.0.24 () {64 vars in 1282 bytes} [Wed May 25 07:28:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 07:28:42.828497 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-831e19fd-6e55-4291-af5f-92489501f2f1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:28:42.829985 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 07:28:42.829985 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: warnings.warn(msg) May 25 07:28:42.957083 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-831e19fd-6e55-4291-af5f-92489501f2f1 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.131970 May 25 07:28:42.957846 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 4/9] 10.222.0.24 () {64 vars in 1335 bytes} [Wed May 25 07:28:42 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:28:45.208185 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-d9bb950a-f343-4a9c-aa50-1d175a365af4 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:28:45.209246 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-d9bb950a-f343-4a9c-aa50-1d175a365af4 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001518 May 25 07:28:45.209645 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 6/10] 10.222.0.24 () {54 vars in 930 bytes} [Wed May 25 07:28:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:28:45.277008 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-40eded09-2671-4146-9c67-5b881776dab4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "ram": 1024, "os-flavor-access:is_public": true, "vcpus": 1, "id": "d2", "rxtx_factor": 1.0, "name": "ds1G", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:28:45.359196 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-40eded09-2671-4146-9c67-5b881776dab4 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.143136 May 25 07:28:45.359772 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 5/11] 10.222.0.24 () {64 vars in 1282 bytes} [Wed May 25 07:28:45 2022] POST /compute/v2.1/flavors => generated 404 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 07:28:45.373097 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-780f8e66-26ed-47d3-8f3e-d030cc7f1495 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:28:45.478705 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-780f8e66-26ed-47d3-8f3e-d030cc7f1495 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.109732 May 25 07:28:45.479421 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 7/12] 10.222.0.24 () {64 vars in 1335 bytes} [Wed May 25 07:28:45 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:28:47.789133 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-40eded09-2671-4146-9c67-5b881776dab4 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:28:47.790514 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-40eded09-2671-4146-9c67-5b881776dab4 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002001 May 25 07:28:47.790942 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 6/13] 10.222.0.24 () {54 vars in 930 bytes} [Wed May 25 07:28:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:28:47.854270 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-4de49c1b-5836-4a60-afa6-91eb3b958185 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "d3", "name": "ds2G", "vcpus": 2, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "ram": 2048, "swap": 0}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:28:47.930896 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-4de49c1b-5836-4a60-afa6-91eb3b958185 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.133195 May 25 07:28:47.931462 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 8/14] 10.222.0.24 () {64 vars in 1282 bytes} [Wed May 25 07:28:47 2022] POST /compute/v2.1/flavors => generated 404 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 07:28:47.943624 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-f9baed8d-c69b-4b27-8fad-291bd7db8e1d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:28:48.047799 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-f9baed8d-c69b-4b27-8fad-291bd7db8e1d admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.107842 May 25 07:28:48.048402 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 7/15] 10.222.0.24 () {64 vars in 1335 bytes} [Wed May 25 07:28:47 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:28:50.296713 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-4de49c1b-5836-4a60-afa6-91eb3b958185 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:28:50.302045 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-4de49c1b-5836-4a60-afa6-91eb3b958185 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001561 May 25 07:28:50.302045 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 9/16] 10.222.0.24 () {54 vars in 930 bytes} [Wed May 25 07:28:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:28:50.363057 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-1fa35f74-923c-41d1-8832-abc886efe3b0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "name": "ds4G", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d4", "os-flavor-access:is_public": true, "ram": 4096, "disk": 20, "vcpus": 4}} {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:28:50.438925 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-1fa35f74-923c-41d1-8832-abc886efe3b0 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.134554 May 25 07:28:50.440044 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 8/17] 10.222.0.24 () {64 vars in 1282 bytes} [Wed May 25 07:28:50 2022] POST /compute/v2.1/flavors => generated 404 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 07:28:50.454171 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-534b15b1-a68b-4e82-94fc-f7ef9f0507fa admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:28:50.533172 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-534b15b1-a68b-4e82-94fc-f7ef9f0507fa admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.084673 May 25 07:28:50.534303 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 10/18] 10.222.0.24 () {64 vars in 1335 bytes} [Wed May 25 07:28:50 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:28:52.797119 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-1fa35f74-923c-41d1-8832-abc886efe3b0 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:28:52.798490 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-1fa35f74-923c-41d1-8832-abc886efe3b0 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001880 May 25 07:28:52.799202 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 9/19] 10.222.0.24 () {54 vars in 930 bytes} [Wed May 25 07:28:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:28:52.862850 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-98960b2c-8009-4453-8f48-5e337a7cd3e2 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:28:52.887505 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-98960b2c-8009-4453-8f48-5e337a7cd3e2 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.080909 May 25 07:28:52.897507 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 11/20] 10.222.0.24 () {60 vars in 1291 bytes} [Wed May 25 07:28:52 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:28:55.387947 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-1fa35f74-923c-41d1-8832-abc886efe3b0 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:28:55.389454 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-1fa35f74-923c-41d1-8832-abc886efe3b0 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002023 May 25 07:28:55.389960 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 10/21] 10.222.0.24 () {54 vars in 930 bytes} [Wed May 25 07:28:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:28:55.453671 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-f7fb7b33-553f-4ae0-b014-dddfc42692bc admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "1", "vcpus": 1, "name": "m1.tiny", "ram": 512}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:28:55.524275 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-f7fb7b33-553f-4ae0-b014-dddfc42692bc admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.128268 May 25 07:28:55.524898 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 12/22] 10.222.0.24 () {64 vars in 1282 bytes} [Wed May 25 07:28:55 2022] POST /compute/v2.1/flavors => generated 402 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 07:28:55.537040 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-76bc1303-c851-4deb-90f7-15d6ca8b1a9d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:28:55.630470 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-76bc1303-c851-4deb-90f7-15d6ca8b1a9d admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097113 May 25 07:28:55.631068 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 11/23] 10.222.0.24 () {64 vars in 1332 bytes} [Wed May 25 07:28:55 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:28:57.867570 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-f7fb7b33-553f-4ae0-b014-dddfc42692bc admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:28:57.868681 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-f7fb7b33-553f-4ae0-b014-dddfc42692bc admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001855 May 25 07:28:57.869102 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 13/24] 10.222.0.24 () {54 vars in 930 bytes} [Wed May 25 07:28:57 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:28:57.941173 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-221db191-d263-4102-9952-9c482de367bb admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 20, "name": "m1.small", "ram": 2048, "id": "2", "os-flavor-access:is_public": true}} {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:28:58.026577 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-221db191-d263-4102-9952-9c482de367bb admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.150190 May 25 07:28:58.027442 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 12/25] 10.222.0.24 () {64 vars in 1282 bytes} [Wed May 25 07:28:57 2022] POST /compute/v2.1/flavors => generated 405 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 07:28:58.041030 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-56725bb9-b661-4bba-97e6-66d792d28df9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:28:58.122976 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-56725bb9-b661-4bba-97e6-66d792d28df9 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085618 May 25 07:28:58.123677 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 14/26] 10.222.0.24 () {64 vars in 1332 bytes} [Wed May 25 07:28:58 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:29:00.380191 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-221db191-d263-4102-9952-9c482de367bb admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:00.381309 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-221db191-d263-4102-9952-9c482de367bb admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001604 May 25 07:29:00.381717 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 13/27] 10.222.0.24 () {54 vars in 930 bytes} [Wed May 25 07:29:00 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:29:00.441215 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-ba9be7fd-5556-47ab-8907-875351aa08aa admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "disk": 40, "id": "3", "ram": 4096, "name": "m1.medium", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:29:00.501107 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-ba9be7fd-5556-47ab-8907-875351aa08aa admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.113294 May 25 07:29:00.501672 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 15/28] 10.222.0.24 () {64 vars in 1282 bytes} [Wed May 25 07:29:00 2022] POST /compute/v2.1/flavors => generated 406 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 07:29:00.513824 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-06051270-017c-483e-8415-aad8ccde95dc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:29:00.583993 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-06051270-017c-483e-8415-aad8ccde95dc admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.073850 May 25 07:29:00.584849 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 14/29] 10.222.0.24 () {64 vars in 1332 bytes} [Wed May 25 07:29:00 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:29:02.806425 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-ba9be7fd-5556-47ab-8907-875351aa08aa admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:02.807559 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-ba9be7fd-5556-47ab-8907-875351aa08aa admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 May 25 07:29:02.807965 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 16/30] 10.222.0.24 () {54 vars in 930 bytes} [Wed May 25 07:29:02 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:29:02.866487 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-76c52745-2781-4937-bf2a-2cd76ce0aa3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 80, "swap": 0, "rxtx_factor": 1.0, "ram": 8192, "id": "4", "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "name": "m1.large", "vcpus": 4}} {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:29:02.991915 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-76c52745-2781-4937-bf2a-2cd76ce0aa3f admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.177754 May 25 07:29:02.992498 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 15/31] 10.222.0.24 () {64 vars in 1282 bytes} [Wed May 25 07:29:02 2022] POST /compute/v2.1/flavors => generated 405 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 07:29:03.004145 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-7255736e-36a2-46ff-83fb-b7829dbf082b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:29:03.111538 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-7255736e-36a2-46ff-83fb-b7829dbf082b admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098258 May 25 07:29:03.111538 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 17/32] 10.222.0.24 () {64 vars in 1332 bytes} [Wed May 25 07:29:02 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:29:05.387268 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-76c52745-2781-4937-bf2a-2cd76ce0aa3f admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:05.388288 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-76c52745-2781-4937-bf2a-2cd76ce0aa3f admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001475 May 25 07:29:05.388720 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 16/33] 10.222.0.24 () {54 vars in 930 bytes} [Wed May 25 07:29:05 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:29:05.453339 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-d8481f2e-a9fc-4c78-8c68-8a934c32eba0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "swap": 0, "rxtx_factor": 1.0, "disk": 160, "name": "m1.xlarge", "id": "5", "ram": 16384}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:29:06.141259 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-d8481f2e-a9fc-4c78-8c68-8a934c32eba0 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.746491 May 25 07:29:06.148741 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 18/34] 10.222.0.24 () {64 vars in 1282 bytes} [Wed May 25 07:29:05 2022] POST /compute/v2.1/flavors => generated 408 bytes in 755 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 07:29:06.155483 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-d6728dc6-8079-45ce-8e56-fdc19604fd7d admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:29:06.264945 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-d6728dc6-8079-45ce-8e56-fdc19604fd7d admin admin] 10.222.0.24 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113431 May 25 07:29:06.280523 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 17/35] 10.222.0.24 () {64 vars in 1332 bytes} [Wed May 25 07:29:06 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:29:30.830035 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-d8481f2e-a9fc-4c78-8c68-8a934c32eba0 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:30.831042 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-d8481f2e-a9fc-4c78-8c68-8a934c32eba0 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001433 May 25 07:29:30.831439 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 19/36] 10.222.0.24 () {54 vars in 930 bytes} [Wed May 25 07:29:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:29:30.842665 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG dbcounter [-] [103787] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:29:30.890364 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-b1a85d9b-c8e0-458d-a89a-23b27a6454f9 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:30.907365 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-b1a85d9b-c8e0-458d-a89a-23b27a6454f9 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.069151 May 25 07:29:30.907898 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 18/37] 10.222.0.24 () {60 vars in 1291 bytes} [Wed May 25 07:29:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:29:31.887627 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-d8481f2e-a9fc-4c78-8c68-8a934c32eba0 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:31.888671 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-d8481f2e-a9fc-4c78-8c68-8a934c32eba0 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 May 25 07:29:31.889069 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 20/38] 10.222.0.24 () {56 vars in 1074 bytes} [Wed May 25 07:29:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:29:32.083673 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-bff4a2a3-c801-42da-a471-eb2aca64180a admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:32.089781 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.wsgi [None req-bff4a2a3-c801-42da-a471-eb2aca64180a admin admin] HTTP exception thrown: Flavor 42 could not be found. May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-bff4a2a3-c801-42da-a471-eb2aca64180a admin admin] Request method failure captured: May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Accept: application/json May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Accept-Encoding: gzip, deflate May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Connection: keep-alive May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Content-Length: 0 May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Host: 10.222.0.24 May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Openstack-Api-Version: compute 2.90 May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Openstack-System-Scope: None May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: User-Agent: python-novaclient May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Auth-Token: gAAAAABijdrbxp0ZUVioH2tpdW2xdqbJdBbmiYRCdXh89og86ZKnQ8O-j9YiN_P_QIVCbfTvmYTKogRevaHmdtBkrqAltwu0WaDJz0xJfj0wkX81C27Z7Clv1xjbDBbkIsJRth0OH-0EFa8KFA3y2lu3C0DGWTvgk4oSGXjXL_D7QCHy554p_Es May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Domain-Id: None May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Domain-Name: None May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Identity-Status: Confirmed May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Is-Admin-Project: True May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Openstack-Nova-Api-Version: 2.90 May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Project-Domain-Id: default May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Project-Domain-Name: Default May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Project-Id: c4db8d1f990d4445ab6059278607233e May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Project-Name: admin May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Role: member,reader,admin May 25 07:29:32.093050 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Roles: member,reader,admin May 25 07:29:32.094922 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4db8d1f990d4445ab6059278607233e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c4db8d1f990d4445ab6059278607233e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c4db8d1f990d4445ab6059278607233e", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4db8d1f990d4445ab6059278607233e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:29:32.094922 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Tenant: admin May 25 07:29:32.094922 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Tenant-Id: c4db8d1f990d4445ab6059278607233e May 25 07:29:32.094922 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Tenant-Name: admin May 25 07:29:32.094922 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-User: admin May 25 07:29:32.094922 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-User-Domain-Id: default May 25 07:29:32.094922 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-User-Domain-Name: Default May 25 07:29:32.094922 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-User-Id: 91002622404a49918bac736d37052f04 May 25 07:29:32.094922 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-User-Name: admin May 25 07:29:32.094922 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: method: > May 25 07:29:32.094922 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: exception: Flavor 42 could not be found. May 25 07:29:32.094922 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: action_args: {'id': '42'} May 25 07:29:32.094922 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:29:32.094922 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:29:32.096151 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 07:29:32.096151 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 07:29:32.096151 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 07:29:32.096151 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 07:29:32.096151 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 07:29:32.096151 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 07:29:32.096151 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 07:29:32.096151 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 07:29:32.096151 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 07:29:32.096151 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:29:32.096151 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 07:29:32.096151 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 07:29:32.096151 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 25 07:29:32.096151 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi May 25 07:29:32.096151 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:29:32.096151 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi May 25 07:29:32.096151 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:29:32.096151 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:29:32.096151 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:29:32.097814 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:29:32.097814 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:29:32.097814 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:29:32.097814 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:29:32.097814 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 07:29:32.097814 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 07:29:32.097814 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 25 07:29:32.097814 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi May 25 07:29:32.097814 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:29:32.097814 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi May 25 07:29:32.097814 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:29:32.097814 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:29:32.097814 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:29:32.097814 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:29:32.097814 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:29:32.097814 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 25 07:29:32.097814 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi May 25 07:29:32.097814 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-bff4a2a3-c801-42da-a471-eb2aca64180a admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:29:32.099164 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-bff4a2a3-c801-42da-a471-eb2aca64180a admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.061168 May 25 07:29:32.099164 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 19/39] 10.222.0.24 () {60 vars in 1190 bytes} [Wed May 25 07:29:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 07:29:32.105344 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-c0b6d8cb-56fd-4707-b361-292ecaab9caa admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:32.108230 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:29:32.126724 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-c0b6d8cb-56fd-4707-b361-292ecaab9caa admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025264 May 25 07:29:32.127269 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 21/40] 10.222.0.24 () {60 vars in 1210 bytes} [Wed May 25 07:29:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:29:32.137257 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-4bf1a6e8-b0ee-4ae5-a209-113c56eb5ea1 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:32.159681 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-4bf1a6e8-b0ee-4ae5-a209-113c56eb5ea1 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026266 May 25 07:29:32.160240 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 20/41] 10.222.0.24 () {60 vars in 1210 bytes} [Wed May 25 07:29:32 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:29:32.170525 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-bbaacf75-e0d0-49dc-af61-0837f6abe9e8 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:32.176511 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.wsgi [None req-bbaacf75-e0d0-49dc-af61-0837f6abe9e8 admin admin] HTTP exception thrown: Flavor 42 could not be found. May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-bbaacf75-e0d0-49dc-af61-0837f6abe9e8 admin admin] Request method failure captured: May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Accept: application/json May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Accept-Encoding: gzip, deflate May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Connection: keep-alive May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Content-Length: 0 May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Host: 10.222.0.24 May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Openstack-Api-Version: compute 2.90 May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Openstack-System-Scope: None May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: User-Agent: python-novaclient May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Auth-Token: gAAAAABijdrbxp0ZUVioH2tpdW2xdqbJdBbmiYRCdXh89og86ZKnQ8O-j9YiN_P_QIVCbfTvmYTKogRevaHmdtBkrqAltwu0WaDJz0xJfj0wkX81C27Z7Clv1xjbDBbkIsJRth0OH-0EFa8KFA3y2lu3C0DGWTvgk4oSGXjXL_D7QCHy554p_Es May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Domain-Id: None May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Domain-Name: None May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Identity-Status: Confirmed May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Is-Admin-Project: True May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Openstack-Nova-Api-Version: 2.90 May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Project-Domain-Id: default May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Project-Domain-Name: Default May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Project-Id: c4db8d1f990d4445ab6059278607233e May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Project-Name: admin May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Role: member,reader,admin May 25 07:29:32.180091 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Roles: member,reader,admin May 25 07:29:32.186385 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4db8d1f990d4445ab6059278607233e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c4db8d1f990d4445ab6059278607233e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c4db8d1f990d4445ab6059278607233e", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4db8d1f990d4445ab6059278607233e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:29:32.186385 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Tenant: admin May 25 07:29:32.186385 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Tenant-Id: c4db8d1f990d4445ab6059278607233e May 25 07:29:32.186385 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Tenant-Name: admin May 25 07:29:32.186385 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-User: admin May 25 07:29:32.186385 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-User-Domain-Id: default May 25 07:29:32.186385 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-User-Domain-Name: Default May 25 07:29:32.186385 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-User-Id: 91002622404a49918bac736d37052f04 May 25 07:29:32.186385 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-User-Name: admin May 25 07:29:32.186385 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: method: > May 25 07:29:32.186385 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: exception: Flavor 42 could not be found. May 25 07:29:32.186385 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: action_args: {'id': '42'} May 25 07:29:32.186385 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:29:32.186385 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:29:32.187392 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 07:29:32.187392 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 07:29:32.187392 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 07:29:32.187392 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 07:29:32.187392 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 07:29:32.187392 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 07:29:32.187392 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 07:29:32.187392 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 07:29:32.187392 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 07:29:32.187392 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:29:32.187392 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 07:29:32.187392 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 07:29:32.187392 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. May 25 07:29:32.187392 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi May 25 07:29:32.187392 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:29:32.187392 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi May 25 07:29:32.187392 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:29:32.187392 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:29:32.187392 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:29:32.188844 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:29:32.188844 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:29:32.188844 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:29:32.188844 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:29:32.188844 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 07:29:32.188844 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 07:29:32.188844 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. May 25 07:29:32.188844 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi May 25 07:29:32.188844 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:29:32.188844 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi May 25 07:29:32.188844 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:29:32.188844 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:29:32.188844 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:29:32.188844 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:29:32.188844 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:29:32.188844 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. May 25 07:29:32.188844 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi May 25 07:29:32.188844 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-bbaacf75-e0d0-49dc-af61-0837f6abe9e8 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:29:32.190121 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-bbaacf75-e0d0-49dc-af61-0837f6abe9e8 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014566 May 25 07:29:32.190121 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 22/42] 10.222.0.24 () {60 vars in 1190 bytes} [Wed May 25 07:29:32 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 25 07:29:33.048753 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-4bf1a6e8-b0ee-4ae5-a209-113c56eb5ea1 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:33.049763 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-4bf1a6e8-b0ee-4ae5-a209-113c56eb5ea1 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 May 25 07:29:33.050151 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 21/43] 10.222.0.24 () {56 vars in 1074 bytes} [Wed May 25 07:29:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:29:33.239290 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-ca25c38f-9966-4092-8d44-833ab24e8b96 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:33.245538 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.wsgi [None req-ca25c38f-9966-4092-8d44-833ab24e8b96 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-ca25c38f-9966-4092-8d44-833ab24e8b96 admin admin] Request method failure captured: May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Accept: application/json May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Accept-Encoding: gzip, deflate May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Connection: keep-alive May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Content-Length: 0 May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Host: 10.222.0.24 May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Openstack-Api-Version: compute 2.90 May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Openstack-System-Scope: None May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: User-Agent: python-novaclient May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Auth-Token: gAAAAABijdrd8TiZ9pCbc0PKhEjNP34Ae0iBK48Qf2VYLBSN6dirOhThjk42chLvYBlPye0savXQOiLfoPJ1HLmubcXSPIITxbDZRlhR7z2J0uL7mgk4P0qrycUGrKezxSJaQurgJWdF9dSc8WQUbVYwDDzUu_bP-jOc4VlTBaEkra3IVI69mjg May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Domain-Id: None May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Domain-Name: None May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Identity-Status: Confirmed May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Is-Admin-Project: True May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Openstack-Nova-Api-Version: 2.90 May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Project-Domain-Id: default May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Project-Domain-Name: Default May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Project-Id: c4db8d1f990d4445ab6059278607233e May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Project-Name: admin May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Role: member,reader,admin May 25 07:29:33.247077 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Roles: member,reader,admin May 25 07:29:33.248407 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4db8d1f990d4445ab6059278607233e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c4db8d1f990d4445ab6059278607233e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c4db8d1f990d4445ab6059278607233e", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4db8d1f990d4445ab6059278607233e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:29:33.248407 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Tenant: admin May 25 07:29:33.248407 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Tenant-Id: c4db8d1f990d4445ab6059278607233e May 25 07:29:33.248407 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Tenant-Name: admin May 25 07:29:33.248407 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-User: admin May 25 07:29:33.248407 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-User-Domain-Id: default May 25 07:29:33.248407 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-User-Domain-Name: Default May 25 07:29:33.248407 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-User-Id: 91002622404a49918bac736d37052f04 May 25 07:29:33.248407 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-User-Name: admin May 25 07:29:33.248407 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: method: > May 25 07:29:33.248407 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: exception: Flavor 84 could not be found. May 25 07:29:33.248407 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: action_args: {'id': '84'} May 25 07:29:33.248407 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:29:33.248407 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:29:33.249244 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 07:29:33.249244 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 07:29:33.249244 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 07:29:33.249244 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 07:29:33.249244 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 07:29:33.249244 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 07:29:33.249244 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 07:29:33.249244 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 07:29:33.249244 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 07:29:33.249244 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:29:33.249244 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 07:29:33.249244 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 07:29:33.249244 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 25 07:29:33.249244 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi May 25 07:29:33.249244 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:29:33.249244 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi May 25 07:29:33.249244 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:29:33.249244 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:29:33.249244 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:29:33.250701 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:29:33.250701 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:29:33.250701 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:29:33.250701 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:29:33.250701 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 07:29:33.250701 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 07:29:33.250701 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 25 07:29:33.250701 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi May 25 07:29:33.250701 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:29:33.250701 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi May 25 07:29:33.250701 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:29:33.250701 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:29:33.250701 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:29:33.250701 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:29:33.250701 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:29:33.250701 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 25 07:29:33.250701 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi May 25 07:29:33.250701 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-ca25c38f-9966-4092-8d44-833ab24e8b96 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:29:33.252029 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-ca25c38f-9966-4092-8d44-833ab24e8b96 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061828 May 25 07:29:33.252029 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 23/44] 10.222.0.24 () {60 vars in 1190 bytes} [Wed May 25 07:29:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 07:29:33.258957 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-30358097-c7ce-4aeb-9ced-fd6f9f3bf8dc admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:33.274448 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-30358097-c7ce-4aeb-9ced-fd6f9f3bf8dc admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019711 May 25 07:29:33.274983 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 22/45] 10.222.0.24 () {60 vars in 1210 bytes} [Wed May 25 07:29:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:29:33.284326 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-8e6c5934-b8e7-4301-959e-ed9ac6aaf031 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:33.298727 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-8e6c5934-b8e7-4301-959e-ed9ac6aaf031 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017930 May 25 07:29:33.299256 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 24/46] 10.222.0.24 () {60 vars in 1210 bytes} [Wed May 25 07:29:33 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:29:33.308684 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-788c47b1-da10-4364-848a-117bb0d26bc1 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:33.314071 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.wsgi [None req-788c47b1-da10-4364-848a-117bb0d26bc1 admin admin] HTTP exception thrown: Flavor 84 could not be found. May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-788c47b1-da10-4364-848a-117bb0d26bc1 admin admin] Request method failure captured: May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Accept: application/json May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Accept-Encoding: gzip, deflate May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Connection: keep-alive May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Content-Length: 0 May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Host: 10.222.0.24 May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Openstack-Api-Version: compute 2.90 May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Openstack-System-Scope: None May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: User-Agent: python-novaclient May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Auth-Token: gAAAAABijdrd8TiZ9pCbc0PKhEjNP34Ae0iBK48Qf2VYLBSN6dirOhThjk42chLvYBlPye0savXQOiLfoPJ1HLmubcXSPIITxbDZRlhR7z2J0uL7mgk4P0qrycUGrKezxSJaQurgJWdF9dSc8WQUbVYwDDzUu_bP-jOc4VlTBaEkra3IVI69mjg May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Domain-Id: None May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Domain-Name: None May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Identity-Status: Confirmed May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Is-Admin-Project: True May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Openstack-Nova-Api-Version: 2.90 May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Project-Domain-Id: default May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Project-Domain-Name: Default May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Project-Id: c4db8d1f990d4445ab6059278607233e May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Project-Name: admin May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Role: member,reader,admin May 25 07:29:33.315900 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Roles: member,reader,admin May 25 07:29:33.317474 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4db8d1f990d4445ab6059278607233e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c4db8d1f990d4445ab6059278607233e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c4db8d1f990d4445ab6059278607233e", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4db8d1f990d4445ab6059278607233e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:29:33.317474 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Tenant: admin May 25 07:29:33.317474 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Tenant-Id: c4db8d1f990d4445ab6059278607233e May 25 07:29:33.317474 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Tenant-Name: admin May 25 07:29:33.317474 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-User: admin May 25 07:29:33.317474 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-User-Domain-Id: default May 25 07:29:33.317474 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-User-Domain-Name: Default May 25 07:29:33.317474 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-User-Id: 91002622404a49918bac736d37052f04 May 25 07:29:33.317474 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-User-Name: admin May 25 07:29:33.317474 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: method: > May 25 07:29:33.317474 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: exception: Flavor 84 could not be found. May 25 07:29:33.317474 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: action_args: {'id': '84'} May 25 07:29:33.317474 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:29:33.317474 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:29:33.318449 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 07:29:33.318449 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 07:29:33.318449 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 07:29:33.318449 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 07:29:33.318449 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 07:29:33.318449 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 07:29:33.318449 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 07:29:33.318449 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 07:29:33.318449 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 07:29:33.318449 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:29:33.318449 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 07:29:33.318449 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 07:29:33.318449 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. May 25 07:29:33.318449 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi May 25 07:29:33.318449 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:29:33.318449 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi May 25 07:29:33.318449 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:29:33.318449 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:29:33.318449 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:29:33.320244 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:29:33.320244 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:29:33.320244 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:29:33.320244 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:29:33.320244 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 07:29:33.320244 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 07:29:33.320244 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. May 25 07:29:33.320244 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi May 25 07:29:33.320244 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:29:33.320244 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi May 25 07:29:33.320244 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:29:33.320244 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:29:33.320244 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:29:33.320244 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:29:33.320244 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:29:33.320244 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. May 25 07:29:33.320244 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi May 25 07:29:33.320244 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-788c47b1-da10-4364-848a-117bb0d26bc1 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:29:33.321502 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-788c47b1-da10-4364-848a-117bb0d26bc1 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.011723 May 25 07:29:33.321502 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 23/47] 10.222.0.24 () {60 vars in 1190 bytes} [Wed May 25 07:29:33 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 07:29:34.171768 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-8e6c5934-b8e7-4301-959e-ed9ac6aaf031 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:34.172800 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-8e6c5934-b8e7-4301-959e-ed9ac6aaf031 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001414 May 25 07:29:34.173199 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 25/48] 10.222.0.24 () {56 vars in 1074 bytes} [Wed May 25 07:29:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:29:34.361690 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-15e0c30b-a76a-493c-9f93-788df73ccd1b admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:34.368025 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.wsgi [None req-15e0c30b-a76a-493c-9f93-788df73ccd1b admin admin] HTTP exception thrown: Flavor 451 could not be found. May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-15e0c30b-a76a-493c-9f93-788df73ccd1b admin admin] Request method failure captured: May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Accept: application/json May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Accept-Encoding: gzip, deflate May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Connection: keep-alive May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Content-Length: 0 May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Host: 10.222.0.24 May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Openstack-Api-Version: compute 2.90 May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Openstack-System-Scope: None May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: User-Agent: python-novaclient May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Auth-Token: gAAAAABijdrexySp9s6vj-za6R36S_Il92QFEJqQ_C5hUl9amVWRwnFyl_0D79_48Oqe7iSVtNcJfAfhtzOG2l4q4Iz1ieufNwbjF9F5lGSnhgTJ9YE_QKzdflCztDXXgyqNJLHm5YEHH4Mkcspf2QevHLtKwioAe4ycSYzxC5lv1EmRUvg4uvY May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Domain-Id: None May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Domain-Name: None May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Identity-Status: Confirmed May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Is-Admin-Project: True May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Openstack-Nova-Api-Version: 2.90 May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Project-Domain-Id: default May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Project-Domain-Name: Default May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Project-Id: c4db8d1f990d4445ab6059278607233e May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Project-Name: admin May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Role: member,reader,admin May 25 07:29:34.369566 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Roles: member,reader,admin May 25 07:29:34.371070 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4db8d1f990d4445ab6059278607233e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c4db8d1f990d4445ab6059278607233e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c4db8d1f990d4445ab6059278607233e", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4db8d1f990d4445ab6059278607233e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:29:34.371070 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Tenant: admin May 25 07:29:34.371070 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Tenant-Id: c4db8d1f990d4445ab6059278607233e May 25 07:29:34.371070 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-Tenant-Name: admin May 25 07:29:34.371070 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-User: admin May 25 07:29:34.371070 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-User-Domain-Id: default May 25 07:29:34.371070 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-User-Domain-Name: Default May 25 07:29:34.371070 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-User-Id: 91002622404a49918bac736d37052f04 May 25 07:29:34.371070 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: X-User-Name: admin May 25 07:29:34.371070 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: method: > May 25 07:29:34.371070 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: exception: Flavor 451 could not be found. May 25 07:29:34.371070 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: action_args: {'id': '451'} May 25 07:29:34.371070 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:29:34.371070 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:29:34.371869 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 07:29:34.371869 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 07:29:34.371869 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 07:29:34.371869 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 07:29:34.371869 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 07:29:34.371869 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 07:29:34.371869 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 07:29:34.371869 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 07:29:34.371869 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 07:29:34.371869 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:29:34.371869 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 07:29:34.371869 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 07:29:34.371869 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 25 07:29:34.371869 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi May 25 07:29:34.371869 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:29:34.371869 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi May 25 07:29:34.371869 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:29:34.371869 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:29:34.371869 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:29:34.372936 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:29:34.372936 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:29:34.372936 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:29:34.372936 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:29:34.372936 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 07:29:34.372936 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 07:29:34.372936 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 25 07:29:34.372936 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi May 25 07:29:34.372936 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:29:34.372936 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi May 25 07:29:34.372936 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:29:34.372936 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:29:34.372936 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:29:34.372936 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:29:34.372936 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:29:34.372936 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 25 07:29:34.372936 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: ERROR nova.api.openstack.wsgi May 25 07:29:34.372936 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-15e0c30b-a76a-493c-9f93-788df73ccd1b admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103787) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:29:34.374006 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-15e0c30b-a76a-493c-9f93-788df73ccd1b admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.060270 May 25 07:29:34.374006 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 24/49] 10.222.0.24 () {60 vars in 1193 bytes} [Wed May 25 07:29:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) May 25 07:29:34.380745 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-a1e69d54-2255-44ca-bdfb-95fadac7162d admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:34.396771 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-a1e69d54-2255-44ca-bdfb-95fadac7162d admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.019498 May 25 07:29:34.397306 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 26/50] 10.222.0.24 () {60 vars in 1210 bytes} [Wed May 25 07:29:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:29:34.406628 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-75b417a6-c580-464f-a3a2-9bdf225f7143 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:34.420326 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-75b417a6-c580-464f-a3a2-9bdf225f7143 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017251 May 25 07:29:34.420883 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 25/51] 10.222.0.24 () {60 vars in 1210 bytes} [Wed May 25 07:29:34 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:29:34.430471 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-e6a434e2-6d57-436e-8c0c-b9c8b73b98bc admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:34.435785 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.wsgi [None req-e6a434e2-6d57-436e-8c0c-b9c8b73b98bc admin admin] HTTP exception thrown: Flavor 451 could not be found. May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-e6a434e2-6d57-436e-8c0c-b9c8b73b98bc admin admin] Request method failure captured: May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Accept: application/json May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Accept-Encoding: gzip, deflate May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Connection: keep-alive May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Content-Length: 0 May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Host: 10.222.0.24 May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Openstack-Api-Version: compute 2.90 May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Openstack-System-Scope: None May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: User-Agent: python-novaclient May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Auth-Token: gAAAAABijdrexySp9s6vj-za6R36S_Il92QFEJqQ_C5hUl9amVWRwnFyl_0D79_48Oqe7iSVtNcJfAfhtzOG2l4q4Iz1ieufNwbjF9F5lGSnhgTJ9YE_QKzdflCztDXXgyqNJLHm5YEHH4Mkcspf2QevHLtKwioAe4ycSYzxC5lv1EmRUvg4uvY May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Domain-Id: None May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Domain-Name: None May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Identity-Status: Confirmed May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Is-Admin-Project: True May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Openstack-Nova-Api-Version: 2.90 May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Project-Domain-Id: default May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Project-Domain-Name: Default May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Project-Id: c4db8d1f990d4445ab6059278607233e May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Project-Name: admin May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Role: member,reader,admin May 25 07:29:34.437301 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Roles: member,reader,admin May 25 07:29:34.438828 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4db8d1f990d4445ab6059278607233e"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c4db8d1f990d4445ab6059278607233e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c4db8d1f990d4445ab6059278607233e", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4db8d1f990d4445ab6059278607233e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:29:34.438828 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Tenant: admin May 25 07:29:34.438828 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Tenant-Id: c4db8d1f990d4445ab6059278607233e May 25 07:29:34.438828 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-Tenant-Name: admin May 25 07:29:34.438828 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-User: admin May 25 07:29:34.438828 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-User-Domain-Id: default May 25 07:29:34.438828 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-User-Domain-Name: Default May 25 07:29:34.438828 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-User-Id: 91002622404a49918bac736d37052f04 May 25 07:29:34.438828 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: X-User-Name: admin May 25 07:29:34.438828 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: method: > May 25 07:29:34.438828 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: exception: Flavor 451 could not be found. May 25 07:29:34.438828 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: action_args: {'id': '451'} May 25 07:29:34.438828 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:29:34.438828 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:29:34.439654 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show May 25 07:29:34.439654 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) May 25 07:29:34.439654 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id May 25 07:29:34.439654 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) May 25 07:29:34.439654 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 07:29:34.439654 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 07:29:34.439654 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id May 25 07:29:34.439654 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, May 25 07:29:34.439654 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper May 25 07:29:34.439654 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:29:34.439654 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db May 25 07:29:34.439654 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) May 25 07:29:34.439654 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. May 25 07:29:34.439654 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi May 25 07:29:34.439654 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:29:34.439654 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi May 25 07:29:34.439654 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:29:34.439654 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:29:34.439654 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:29:34.440936 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:29:34.440936 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:29:34.440936 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:29:34.440936 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:29:34.440936 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show May 25 07:29:34.440936 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) May 25 07:29:34.440936 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. May 25 07:29:34.440936 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi May 25 07:29:34.440936 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:29:34.440936 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi May 25 07:29:34.440936 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:29:34.440936 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:29:34.440936 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:29:34.440936 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:29:34.440936 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:29:34.440936 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. May 25 07:29:34.440936 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: ERROR nova.api.openstack.wsgi May 25 07:29:34.440936 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-e6a434e2-6d57-436e-8c0c-b9c8b73b98bc admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103786) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:29:34.442222 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-e6a434e2-6d57-436e-8c0c-b9c8b73b98bc admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012205 May 25 07:29:34.442222 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 27/52] 10.222.0.24 () {60 vars in 1193 bytes} [Wed May 25 07:29:34 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) May 25 07:29:35.300737 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-75b417a6-c580-464f-a3a2-9bdf225f7143 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:35.301769 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-75b417a6-c580-464f-a3a2-9bdf225f7143 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001494 May 25 07:29:35.302175 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 26/53] 10.222.0.24 () {56 vars in 1074 bytes} [Wed May 25 07:29:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:29:35.489970 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-6cc89d94-3468-402b-8af6-3f988a87a62a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:29:35.568194 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-6cc89d94-3468-402b-8af6-3f988a87a62a admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.130605 May 25 07:29:35.568915 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 28/54] 10.222.0.24 () {64 vars in 1235 bytes} [Wed May 25 07:29:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 07:29:36.432557 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-75b417a6-c580-464f-a3a2-9bdf225f7143 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:36.433562 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-75b417a6-c580-464f-a3a2-9bdf225f7143 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001449 May 25 07:29:36.433955 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 27/55] 10.222.0.24 () {56 vars in 1074 bytes} [Wed May 25 07:29:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:29:36.620273 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-f01e8c58-0e4a-46a3-b98f-dcc36e384fc9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:29:36.698816 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-f01e8c58-0e4a-46a3-b98f-dcc36e384fc9 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.130692 May 25 07:29:36.699403 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 29/56] 10.222.0.24 () {64 vars in 1235 bytes} [Wed May 25 07:29:36 2022] POST /compute/v2.1/flavors => generated 405 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 07:29:37.561949 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-75b417a6-c580-464f-a3a2-9bdf225f7143 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:37.562954 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-75b417a6-c580-464f-a3a2-9bdf225f7143 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 May 25 07:29:37.563344 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 28/57] 10.222.0.24 () {56 vars in 1074 bytes} [Wed May 25 07:29:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:29:37.751747 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-43b901bb-eb2d-4dc3-ac2c-18d1affe9529 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:29:37.869974 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-43b901bb-eb2d-4dc3-ac2c-18d1affe9529 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.170712 May 25 07:29:37.870547 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 30/58] 10.222.0.24 () {64 vars in 1235 bytes} [Wed May 25 07:29:37 2022] POST /compute/v2.1/flavors => generated 407 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 07:29:38.737052 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-75b417a6-c580-464f-a3a2-9bdf225f7143 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:38.738062 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-75b417a6-c580-464f-a3a2-9bdf225f7143 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001529 May 25 07:29:38.738462 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 29/59] 10.222.0.24 () {56 vars in 1074 bytes} [Wed May 25 07:29:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:29:38.929259 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-aa90b07c-be84-48fc-93aa-594582b29552 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:29:38.997452 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-aa90b07c-be84-48fc-93aa-594582b29552 admin admin] 10.222.0.24 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.121093 May 25 07:29:38.997966 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 31/60] 10.222.0.24 () {64 vars in 1235 bytes} [Wed May 25 07:29:38 2022] POST /compute/v2.1/flavors => generated 409 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 07:29:39.860083 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-75b417a6-c580-464f-a3a2-9bdf225f7143 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:39.861114 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-75b417a6-c580-464f-a3a2-9bdf225f7143 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 May 25 07:29:39.861509 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 30/61] 10.222.0.24 () {56 vars in 1074 bytes} [Wed May 25 07:29:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:29:40.050026 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-015f3f4b-69f1-4fb4-a5c9-04e54ac92b55 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:29:40.069782 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-015f3f4b-69f1-4fb4-a5c9-04e54ac92b55 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.073255 May 25 07:29:40.070299 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 32/62] 10.222.0.24 () {60 vars in 1202 bytes} [Wed May 25 07:29:39 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:30:42.532031 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-75b417a6-c580-464f-a3a2-9bdf225f7143 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:30:42.533103 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-75b417a6-c580-464f-a3a2-9bdf225f7143 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001495 May 25 07:30:42.533504 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 31/63] 10.222.0.24 () {54 vars in 930 bytes} [Wed May 25 07:30:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:30:42.541827 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:30:42.593992 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-1f0d9cb7-fba8-4e53-8f84-6dd8023e4af3 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:30:42.614875 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-1f0d9cb7-fba8-4e53-8f84-6dd8023e4af3 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.074468 May 25 07:30:42.615433 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 33/64] 10.222.0.24 () {60 vars in 1291 bytes} [Wed May 25 07:30:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:30:42.635687 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG dbcounter [-] [103787] Writing DB stats nova_api:SELECT=14 {{(pid=103787) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:30:42.639484 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-99486a68-944f-4c96-9e03-5fdf301f1329 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:30:42.647980 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-99486a68-944f-4c96-9e03-5fdf301f1329 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013920 May 25 07:30:42.648525 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 32/65] 10.222.0.24 () {60 vars in 1282 bytes} [Wed May 25 07:30:42 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:30:42.660174 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-44035e4b-b118-474c-8913-72ba5092b277 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:30:42.668949 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-44035e4b-b118-474c-8913-72ba5092b277 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012699 May 25 07:30:42.669478 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 34/66] 10.222.0.24 () {60 vars in 1285 bytes} [Wed May 25 07:30:42 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:30:42.680962 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-35332e7c-fb3f-426c-a072-26510e1e4377 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:30:42.688715 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-35332e7c-fb3f-426c-a072-26510e1e4377 admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011375 May 25 07:30:42.689235 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 33/67] 10.222.0.24 () {60 vars in 1285 bytes} [Wed May 25 07:30:42 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:30:42.702103 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-064e8051-9fd7-42d4-905a-b7c9c70c53af admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:30:42.710438 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-064e8051-9fd7-42d4-905a-b7c9c70c53af admin admin] 10.222.0.24 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012044 May 25 07:30:42.711028 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 35/68] 10.222.0.24 () {60 vars in 1282 bytes} [Wed May 25 07:30:42 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:34:26.984005 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-35332e7c-fb3f-426c-a072-26510e1e4377 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:34:26.985117 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-35332e7c-fb3f-426c-a072-26510e1e4377 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001607 May 25 07:34:26.985515 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 34/69] 10.222.0.24 () {56 vars in 1074 bytes} [Wed May 25 07:34:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:34:27.162717 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writing DB stats nova_api:SELECT=6 {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:34:27.298763 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-2ccb2c51-74ee-4bdd-a453-b77e8580f714 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:34:27.306480 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 07:34:27.306480 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: warnings.warn(msg) May 25 07:34:27.306480 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-2ccb2c51-74ee-4bdd-a453-b77e8580f714 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:34:27.306480 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-2ccb2c51-74ee-4bdd-a453-b77e8580f714 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:34:27.306480 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-2ccb2c51-74ee-4bdd-a453-b77e8580f714 admin admin] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:34:27.306480 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-2ccb2c51-74ee-4bdd-a453-b77e8580f714 admin admin] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:34:27.339963 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-2ccb2c51-74ee-4bdd-a453-b77e8580f714 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.178330 May 25 07:34:27.340562 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 36/70] 10.222.0.24 () {60 vars in 1193 bytes} [Wed May 25 07:34:27 2022] GET /compute/v2.1/os-services => generated 794 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 07:34:28.257397 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-35332e7c-fb3f-426c-a072-26510e1e4377 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:34:28.258927 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-35332e7c-fb3f-426c-a072-26510e1e4377 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001937 May 25 07:34:28.259326 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 35/71] 10.222.0.24 () {56 vars in 1074 bytes} [Wed May 25 07:34:28 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:34:28.445449 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-8dcf9115-a3b4-4307-9390-4af6e1320c2a admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:34:28.446645 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 07:34:28.446645 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: warnings.warn(msg) May 25 07:34:28.447828 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-8dcf9115-a3b4-4307-9390-4af6e1320c2a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:34:28.448272 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-8dcf9115-a3b4-4307-9390-4af6e1320c2a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:34:28.449115 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-8dcf9115-a3b4-4307-9390-4af6e1320c2a admin admin] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:34:28.449565 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-8dcf9115-a3b4-4307-9390-4af6e1320c2a admin admin] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:34:28.469175 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-8dcf9115-a3b4-4307-9390-4af6e1320c2a admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.073414 May 25 07:34:28.469721 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 37/72] 10.222.0.24 () {60 vars in 1193 bytes} [Wed May 25 07:34:28 2022] GET /compute/v2.1/os-services => generated 794 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 07:34:39.757325 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-35332e7c-fb3f-426c-a072-26510e1e4377 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:34:39.758336 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-35332e7c-fb3f-426c-a072-26510e1e4377 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 May 25 07:34:39.758734 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 36/73] 10.222.0.24 () {56 vars in 1074 bytes} [Wed May 25 07:34:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:34:39.900692 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writing DB stats nova_cell0:SELECT=4 {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:34:39.901342 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writing DB stats nova_cell1:SELECT=4 {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:34:39.901963 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG dbcounter [-] [103786] Writing DB stats nova_api:SELECT=8 {{(pid=103786) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:34:39.949549 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-50d59bd1-aee4-4483-be18-6979c4ab42f3 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:34:39.950745 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 07:34:39.950745 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: warnings.warn(msg) May 25 07:34:39.951920 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-50d59bd1-aee4-4483-be18-6979c4ab42f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:34:39.952355 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-50d59bd1-aee4-4483-be18-6979c4ab42f3 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:34:39.953282 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-50d59bd1-aee4-4483-be18-6979c4ab42f3 admin admin] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:34:39.953711 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-50d59bd1-aee4-4483-be18-6979c4ab42f3 admin admin] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:34:39.979361 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-50d59bd1-aee4-4483-be18-6979c4ab42f3 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.083149 May 25 07:34:39.979937 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 38/74] 10.222.0.24 () {60 vars in 1193 bytes} [Wed May 25 07:34:39 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:34:40.859702 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: DEBUG nova.api.openstack.wsgi [None req-35332e7c-fb3f-426c-a072-26510e1e4377 admin admin] Calling method '>' {{(pid=103787) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:34:40.860751 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: INFO nova.api.openstack.requestlog [None req-35332e7c-fb3f-426c-a072-26510e1e4377 admin admin] 10.222.0.24 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 May 25 07:34:40.861154 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: [pid: 103787|app: 0|req: 37/75] 10.222.0.24 () {56 vars in 1074 bytes} [Wed May 25 07:34:40 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:34:41.051901 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG nova.api.openstack.wsgi [None req-320c1722-8c41-4a72-9666-635c645f6012 admin admin] Calling method '>' {{(pid=103786) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:34:41.053145 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 25 07:34:41.053145 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: warnings.warn(msg) May 25 07:34:41.054413 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-320c1722-8c41-4a72-9666-635c645f6012 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:34:41.054877 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-320c1722-8c41-4a72-9666-635c645f6012 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:34:41.055659 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-320c1722-8c41-4a72-9666-635c645f6012 admin admin] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:34:41.056084 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: DEBUG oslo_concurrency.lockutils [None req-320c1722-8c41-4a72-9666-635c645f6012 admin admin] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103786) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:34:41.077368 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: INFO nova.api.openstack.requestlog [None req-320c1722-8c41-4a72-9666-635c645f6012 admin admin] 10.222.0.24 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.90 time: 0.078175 May 25 07:34:41.077907 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: [pid: 103786|app: 0|req: 39/76] 10.222.0.24 () {60 vars in 1193 bytes} [Wed May 25 07:34:40 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:35:36.985958 dv-cinder-825492-15-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... May 25 07:35:36.988876 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: Wed May 25 07:35:36 2022 - graceful shutdown triggered... May 25 07:35:36.989460 dv-cinder-825492-15-iscsi devstack@n-api.service[103787]: Gracefully killing worker 2 (pid: 103787)... May 25 07:35:36.989834 dv-cinder-825492-15-iscsi devstack@n-api.service[103786]: Gracefully killing worker 1 (pid: 103786)... May 25 07:35:37.987314 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: worker 1 buried after 1 seconds May 25 07:35:37.987314 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: worker 2 buried after 1 seconds May 25 07:35:37.987314 dv-cinder-825492-15-iscsi devstack@n-api.service[103785]: goodbye to uWSGI. May 25 07:35:37.988905 dv-cinder-825492-15-iscsi systemd[1]: devstack@n-api.service: Succeeded. May 25 07:35:37.989786 dv-cinder-825492-15-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. May 25 07:35:37.992721 dv-cinder-825492-15-iscsi systemd[1]: Starting Devstack devstack@n-api.service... May 25 07:35:38.006315 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini May 25 07:35:38.021706 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: *** Starting uWSGI 2.0.18-debian (64bit) on [Wed May 25 07:35:38 2022] *** May 25 07:35:38.021706 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 25 07:35:38.021706 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 25 07:35:38.021706 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: nodename: dv-cinder-825492-15-iscsi May 25 07:35:38.021706 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: machine: x86_64 May 25 07:35:38.021706 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: clock source: unix May 25 07:35:38.021706 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: pcre jit disabled May 25 07:35:38.021706 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: detected number of CPU cores: 4 May 25 07:35:38.021706 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: current working directory: / May 25 07:35:38.021706 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: detected binary path: /usr/bin/uwsgi-core May 25 07:35:38.022528 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: your processes number limit is 47680 May 25 07:35:38.022528 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: your memory page size is 4096 bytes May 25 07:35:38.022528 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: detected max file descriptor number: 2048 May 25 07:35:38.022528 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: lock engine: pthread robust mutexes May 25 07:35:38.022528 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: thunder lock: enabled May 25 07:35:38.022528 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 May 25 07:35:38.022528 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 25 07:35:38.073542 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: Python main interpreter initialized at 0x55b11608e9c0 May 25 07:35:38.073542 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: python threads support enabled May 25 07:35:38.073542 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: your server socket listen backlog is limited to 100 connections May 25 07:35:38.073542 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: your mercy for graceful operations on workers is 90 seconds May 25 07:35:38.074003 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: mapped 403077 bytes (393 KB) for 2 cores May 25 07:35:38.074003 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: *** Operational MODE: preforking *** May 25 07:35:38.074291 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: *** uWSGI is running in multiple interpreter mode *** May 25 07:35:38.074291 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: spawned uWSGI master process (pid: 124653) May 25 07:35:38.074497 dv-cinder-825492-15-iscsi systemd[1]: Started Devstack devstack@n-api.service. May 25 07:35:38.075124 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: spawned uWSGI worker 1 (pid: 124674, cores: 1) May 25 07:35:38.077266 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: spawned uWSGI worker 2 (pid: 124675, cores: 1) May 25 07:35:38.077518 dv-cinder-825492-15-iscsi devstack@n-api.service[124653]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 25 07:35:39.271659 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 07:35:39.302344 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. May 25 07:35:40.075296 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 07:35:40.075296 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: from cryptography.utils import int_from_bytes May 25 07:35:40.075682 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 07:35:40.075682 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: from cryptography.utils import int_from_bytes May 25 07:35:40.140237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 07:35:40.140237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: from cryptography.utils import int_from_bytes May 25 07:35:40.140930 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 25 07:35:40.140930 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: from cryptography.utils import int_from_bytes May 25 07:35:42.487782 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 07:35:42.488353 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 07:35:42.488635 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 07:35:42.489002 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 07:35:42.489263 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 07:35:42.489665 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.489993 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.490318 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.490638 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.490972 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.491285 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.491608 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.491931 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.492259 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.492545 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.493201 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.493201 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-15-iscsi {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.493490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.493801 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.494116 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.494437 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.494742 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.495117 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.495371 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.495894 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.497205 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.497205 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.497205 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.497509 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.497596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.497894 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.498217 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.498527 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.498854 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.499165 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.499574 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-15-iscsi {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.499895 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.500208 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.500546 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.501634 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.501944 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.502284 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.502681 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.503012 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.503324 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.503656 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.503979 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.504301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.504650 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.504956 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.505266 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.505577 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.505896 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.506200 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.506510 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.506762 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.507067 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.507389 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.507725 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.508031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.508283 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.508583 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.508878 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.509196 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.509505 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.509812 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.510119 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.510425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.510730 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.511034 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.511379 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.511636 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.511955 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.512268 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.512618 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.512922 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.513241 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.513641 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.513897 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.514204 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.514541 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.514859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.515167 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.515487 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.515806 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.516114 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.516631 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.517003 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.517574 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.517761 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.518083 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.518321 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.518637 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.518950 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.519270 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.519575 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.519881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.520186 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.520497 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.520815 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.521122 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.521427 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.521732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.522041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.522342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.522646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.522952 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.523257 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.523575 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.523905 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.524202 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.524715 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.524837 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.525132 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.525450 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.525758 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.526060 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.526381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.526691 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.526993 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.527312 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.527621 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.527925 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.528241 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.528564 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.528871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.529188 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.529494 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.529798 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.530101 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.530404 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.530706 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.531008 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.531308 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.531611 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.531958 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.532463 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.532830 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.533144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.533452 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.533757 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.534078 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.534421 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.534753 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.535097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.535415 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.535747 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.536082 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.536400 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.536749 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.537064 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.537390 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.538603 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.538603 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.538603 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.538603 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.539225 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.539225 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.539534 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.539852 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.540170 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.540563 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.540821 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.541147 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.541473 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.541786 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.542127 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.542474 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.542787 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.543113 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.543436 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.543749 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.544061 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.544370 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.544800 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.545161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.545479 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.545798 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.546116 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.546429 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.546748 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.547079 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.547394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.548268 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.548610 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.549125 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.549447 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.549767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.550103 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.550418 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.550732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.551042 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.551350 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.551656 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.551966 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.552272 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.552638 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.552964 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.553273 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.553609 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.553938 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.554251 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.554564 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.554892 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.555201 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.555560 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.555817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.556123 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.556934 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.556934 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.557248 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.557405 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.557690 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.557998 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.558312 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.558625 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.558937 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.559249 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.559561 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.559886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.560199 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.560773 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.560947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.561184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.561491 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.561816 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.562139 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.562454 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.562761 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.563069 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.563488 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.563799 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.564103 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.564412 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.565243 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.565243 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.565563 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.565739 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.565953 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.566247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.566557 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.566870 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.567174 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.567474 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.567821 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.568127 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.568471 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.568829 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.569149 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.569471 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.569782 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.570100 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.570409 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.570715 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.571027 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.571338 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.571658 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.571970 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.572290 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.572683 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.572985 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.573263 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.573863 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.573863 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.574289 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.574509 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.574840 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.575159 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.575477 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.575836 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.576202 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.576618 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.576790 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.577035 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.577348 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.577663 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.578058 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.578291 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.578600 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.579466 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.579776 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.580097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.580400 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.584582 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.584582 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.584582 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.584582 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.584582 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.584582 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.584582 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.584582 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.585772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.585772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.585772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.585772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.585772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.585772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.585772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.585772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.586942 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.586942 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.586942 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.586942 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.586942 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.587652 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.587652 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.587652 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.588082 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.588225 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.588954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.588954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.589326 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.589474 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.593338 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.593338 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.593338 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.593338 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.593338 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.593338 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.593338 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.593338 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.594595 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.594595 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.594595 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.594595 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.594595 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.594595 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.594595 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.594595 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.597588 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.597588 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.597588 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.597588 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.597588 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.597588 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.597588 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.597588 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.601271 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.601271 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.601271 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.601271 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.601271 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.601271 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.601271 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.601271 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.603287 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.603287 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.603287 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.603287 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.603287 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.603287 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.603287 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.603287 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.604378 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.604378 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.604378 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.604378 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.604378 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.604378 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.605301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.605301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.605301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.606360 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.606360 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.606360 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.606796 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.606796 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.607092 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.607376 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.607719 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.608023 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.608362 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.608717 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.609059 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.609365 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.609667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.609991 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.610571 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.610802 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.611299 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.611462 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.611726 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.612028 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.612338 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.612674 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.612985 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.613293 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.613596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.613906 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.614210 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.614524 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.614830 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.615132 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.615434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.615743 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.616119 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.616649 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.616649 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.616941 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.617258 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.617562 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.617864 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.620802 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.620802 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.620802 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.620802 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.620802 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.620802 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.620802 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.620802 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.622191 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.622191 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.622191 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.622191 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.622191 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.622191 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.622998 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.622998 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.622998 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.623434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.623434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.623738 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.624033 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.624334 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.624662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.624966 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.625268 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.625589 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.625949 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.626261 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.626751 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.626912 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.627178 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.627481 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.627838 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.628143 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.628455 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.628804 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.629117 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.629430 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.629744 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.630056 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.630364 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.630674 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.630972 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.631277 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.631659 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.631894 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.632205 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.632534 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.637089 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.637089 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.637089 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.637089 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.637089 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.637089 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.637089 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.637089 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.638207 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.638207 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.638207 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.638207 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.638207 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.638207 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.638207 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.638207 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.639311 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.639311 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.639311 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.639311 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.639311 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.639311 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.640164 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.640164 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.640164 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.640634 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.641066 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.641228 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.642092 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.643658 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.644010 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.644339 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.644689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.645004 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.645437 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.645756 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.646073 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.646394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.646693 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.647113 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.647364 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.647619 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.647927 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.648234 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.648572 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.648900 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.649206 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.649527 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.649945 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.650259 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.650564 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.650978 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.651317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.651583 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.651907 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.652242 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.652561 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.652869 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.653184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.653493 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.653817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.654141 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.654452 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.654767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.655072 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.655462 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.655711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.656024 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.656346 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.656786 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.657388 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.657683 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.657856 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.658163 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.658472 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.658777 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.659089 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.659396 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.659700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.660022 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.660327 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.660665 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.660978 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.661309 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.661576 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.661879 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.662283 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.662551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.662819 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.663131 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.663453 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.663776 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.664081 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.664403 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.667538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.667538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.667538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.667538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.667538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.667538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.667538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.667538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.668924 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.668924 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.668924 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.668924 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.668924 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.668924 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.669838 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.669838 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.669838 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.670272 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.670272 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.672105 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.672105 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.672105 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.672105 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.672105 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.672105 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.674099 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.674099 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.674099 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.674099 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.674099 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.674901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.674901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.675197 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.675355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.675585 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.676074 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.676245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.676574 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.676873 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.677197 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.677681 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.677870 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.678120 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.678436 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.678753 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.679137 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.679465 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.679778 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.680170 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.680513 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.680843 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.681478 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.681746 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.682146 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.682373 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.682710 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.682985 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.683297 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.683608 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.683973 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.684283 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.684618 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.684949 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.685275 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.685604 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.685944 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.686262 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.686575 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.686987 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.687204 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.687571 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.687966 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.688873 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.689132 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.689424 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.689702 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.690014 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.690324 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.690636 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.690948 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.691262 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.692087 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.692087 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.692517 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.692517 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.693197 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.693197 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.693507 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.693742 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.694060 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.694608 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.695190 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.695536 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.699695 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.699695 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.699695 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.699695 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.699695 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.699695 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.699695 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.699695 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.701004 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.701004 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.701004 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.701004 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.701004 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.701004 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.701004 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.701004 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.702984 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.702984 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.702984 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.702984 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.702984 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.704841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 25 07:35:42.704841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 25 07:35:42.705578 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.705578 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.705939 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 25 07:35:42.706091 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.706091 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.706387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 25 07:35:42.706387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 25 07:35:42.706914 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.706914 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.707191 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.707334 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.707334 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.707570 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.707684 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.707684 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.707945 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.708063 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.708063 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.708271 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.708381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.708381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.714961 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.715196 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.715196 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.715515 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.715677 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.715677 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.716033 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.716187 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.716350 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.716557 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.716557 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.716557 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.717061 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.717719 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.717882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.718080 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.718080 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.718387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.718559 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.718559 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.718894 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-825492-15-iscsi {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.719056 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.719056 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.719463 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.720211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.720211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.720538 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.720711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.721204 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.721370 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.721522 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.721693 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.721854 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.722006 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.722206 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.722373 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.722533 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.722684 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.722684 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.723008 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.723192 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.723496 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.724009 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.724179 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.724179 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.724570 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.724737 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.724907 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.725060 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.725219 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.725369 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.725530 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.725688 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.725867 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.726030 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.726192 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.726386 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.726553 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.726713 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.727133 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.727133 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.727467 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-825492-15-iscsi {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.727624 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.727774 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.727934 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.728093 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.728251 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.728416 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.728638 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.728803 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.729544 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.729744 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.729901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.729901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.730208 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.730415 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.730415 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.731410 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.731588 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.731742 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.731897 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.732068 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.732221 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.732373 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.732578 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.732746 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.732900 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.733061 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.733214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.733365 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.733635 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.733821 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.734234 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.734401 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.734597 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.734788 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.734955 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.735431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.735607 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.735760 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.735912 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.736219 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.736423 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.736621 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.736798 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.736951 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.737110 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.737261 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.737445 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.737617 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.737777 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.737935 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.738092 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.738251 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.738251 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.738626 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.738797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.738950 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.739101 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.739253 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.739484 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.739694 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.739848 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.740007 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.740166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.740319 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.740510 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.744626 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.744626 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.748295 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.748406 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.748530 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.748645 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.748737 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.748737 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.748905 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.748905 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.749077 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.749180 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.749270 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.749364 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.749459 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.749547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.749643 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.749643 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.749801 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.749801 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.749958 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.24 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.750043 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.750138 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.24 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.750240 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.750336 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.750423 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.750516 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.750611 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.751264 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.751356 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.751443 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.751529 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.751529 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.751698 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.751780 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.751853 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.751938 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.752023 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.752116 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.752116 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.752358 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.752443 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.752553 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.752641 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.752726 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.752825 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.752915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.753003 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.753097 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.753185 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.753294 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.753395 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.753483 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.753570 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.753655 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.753756 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.753845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.753941 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.754036 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.754123 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.754232 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.754335 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.754433 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.754530 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.754618 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.754711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.754798 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.754890 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.754991 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.755086 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.755181 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.755276 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.755364 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.755364 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.755546 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.755642 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.755642 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.755642 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.755642 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.755943 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.756039 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.756134 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.756227 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.756322 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.756416 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.756538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.756623 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.756710 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.756801 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.756895 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.756994 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.757081 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.757166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.757259 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.757354 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.757448 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.757448 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.757605 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.757690 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.757776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.757875 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.758248 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.758338 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.758433 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.758520 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.758606 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.758710 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.758798 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.758892 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.758980 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.759073 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.759175 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.759270 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.759364 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.759459 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.759554 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.759673 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.759773 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.759862 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.759947 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.760033 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.760120 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.760213 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.760313 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.760401 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.760512 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.760613 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.760613 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.760791 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.760887 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.760976 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.761061 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.761155 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.761250 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.761350 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.761444 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.761531 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.761624 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.761718 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.761814 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.761910 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.761998 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.762083 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.762167 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.762260 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.762354 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.762456 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.762543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.762628 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 25 07:35:42.762721 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.762817 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.762912 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.762999 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.763079 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.763079 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.763222 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.763317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.763418 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.763506 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124675) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 07:35:42.763600 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.763600 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.763600 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.763600 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.763600 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.763600 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.763600 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.763600 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.764225 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.764225 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.764225 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.764225 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.764225 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.764225 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.764225 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.764225 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.764900 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.764900 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.764900 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.764900 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.764900 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.764900 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.764900 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.765440 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.765440 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.765760 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.766085 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.766495 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.767093 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.767453 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.767782 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.768283 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.768632 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.769084 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.769698 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.769848 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.770078 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.770449 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.770773 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.771101 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.771424 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.771751 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.772074 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.772395 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.772741 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.773058 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.773372 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.773712 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.774033 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.774347 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.774763 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.775010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.775350 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.775700 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.776015 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.776335 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.776813 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.777196 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.777516 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.777864 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.778459 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.778672 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.779143 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.779378 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.779711 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.780061 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.780581 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.780911 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.782798 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.782798 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.782798 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.783032 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.783529 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.783808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.784138 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.784464 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.784836 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.785197 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.785516 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.785854 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.786212 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.786540 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.786853 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.787178 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.787493 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.787805 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.788117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.788557 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.788782 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.789077 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.789388 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.789701 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.790011 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.790340 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.790656 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.790968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.791352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.791661 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.792018 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.792333 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.792733 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.793057 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.793386 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.793718 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.794038 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.794452 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.794776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.795098 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.795421 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.795760 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.796074 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.796396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.796753 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.797126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.797471 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.798508 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.798971 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.799292 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.799622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.799976 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.800317 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.800670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.800996 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.801315 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.801638 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.801956 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.802273 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.802592 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.802910 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.803235 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.803554 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.803909 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.804228 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.804581 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.804901 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.805227 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.805537 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.805857 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.806193 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.806533 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.806850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.807175 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.807504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.807820 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.808136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.808454 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.808790 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.809141 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.809425 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.809747 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.810148 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.810380 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.810695 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.811019 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.811331 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.811641 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.811952 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.812269 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.812626 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.812949 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.813435 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.814019 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.814374 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.814693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.815029 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.815374 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.815692 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.816007 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.816321 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.816699 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.817020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.817337 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.817680 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.818012 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.818333 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.818843 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.819015 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO dbcounter [None req-a42f9b0a-9fbc-4fb3-8d76-c399cdbcb73e None None] Registered counter for database nova_api May 25 07:35:42.819226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.819371 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.819593 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.819918 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.820285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.820596 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.820921 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.821264 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.821585 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.821918 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.822237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.822555 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.822922 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.823285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.823608 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.823936 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.824568 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.824893 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.825223 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.825553 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.825883 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.826222 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.826573 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.826912 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.827272 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.827587 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.827906 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.828265 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.828553 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.829045 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.829524 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.829969 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.830290 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.830611 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.830926 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.831303 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.831618 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.831934 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.832259 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.832672 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.832995 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.833309 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.833644 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.833964 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.834560 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.834705 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.835111 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.835464 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.835781 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.836131 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.836471 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.836842 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.837226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.837546 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.837880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.838193 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.838505 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.838816 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.839129 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_db.sqlalchemy.engines [None req-a42f9b0a-9fbc-4fb3-8d76-c399cdbcb73e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 07:35:42.839355 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.839495 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.839774 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.840081 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.840397 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.840766 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.841061 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.841373 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.841690 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.842002 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.842322 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.842636 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.842950 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.843261 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.843577 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.843924 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.844236 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.845273 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.845827 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.846209 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.846534 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.846851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.847175 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.847349 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writer thread running {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 07:35:42.847542 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.847803 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.848147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.848447 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.848792 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.849174 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.849513 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.849738 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.850040 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.850355 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.850672 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.851005 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.851331 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.851645 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.852230 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.852569 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.852887 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.853201 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.853518 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.853829 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.854139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.854449 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.854778 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.855071 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.855427 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.855746 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.856072 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.856391 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.856729 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.857085 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.857403 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.857793 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.858107 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.858431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.858756 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.859075 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.859552 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.859748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.860049 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.860622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.861155 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.861485 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.861802 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.862117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.862449 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.862771 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.863089 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.863442 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.863774 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.864110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.864425 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.864771 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.865112 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.865408 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.865725 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.866042 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.866362 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.866682 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.867001 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.867326 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.867644 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.867956 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.868272 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.868614 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.868930 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.869262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.869656 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.869886 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.870203 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.870515 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.870852 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.871170 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.871602 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.871921 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.872241 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.872575 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.872896 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.873218 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.873565 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.873888 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.874201 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.874654 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.874975 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.875295 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.876131 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.876636 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.877115 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.877439 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.877791 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.878120 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.878436 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.878749 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.879082 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.879419 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.879753 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.880181 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.880523 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.880842 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.881265 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.881586 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.881902 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.882232 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.882563 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.882895 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.883206 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.883569 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.883829 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.884182 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.884643 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.884849 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.885173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.885485 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.885815 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.886147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.886468 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.886797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.887221 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.887554 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.887876 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.888206 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.888564 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.888884 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.889197 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.889516 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.889847 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.890136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.890466 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.890776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.891093 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.892094 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.892687 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.893048 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.893332 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.893669 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.893986 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.894323 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.894649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.894983 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.895317 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.895633 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.895965 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.896283 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.896700 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.897005 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.897314 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.897670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.897984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.898312 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.898648 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.898986 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.899304 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.899667 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.900005 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.900345 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.900683 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.901018 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.901334 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.901649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.901969 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.902281 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.902595 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.902907 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.903223 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.903534 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.903845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.904156 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.904510 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.904685 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.context [None req-a42f9b0a-9fbc-4fb3-8d76-c399cdbcb73e None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b54eaccb-ae13-4b47-bdce-eca4e8d593ce(cell1) {{(pid=124675) load_cells /opt/stack/nova/nova/context.py:464}} May 25 07:35:42.904848 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.905139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.905457 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.905770 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.906085 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.906397 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.906818 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.907144 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.907790 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.908145 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.908499 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.908845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.909014 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a42f9b0a-9fbc-4fb3-8d76-c399cdbcb73e None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:35:42.909173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.909492 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.909820 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.910128 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.910452 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a42f9b0a-9fbc-4fb3-8d76-c399cdbcb73e None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:35:42.910636 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.910861 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.911086 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.911245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a42f9b0a-9fbc-4fb3-8d76-c399cdbcb73e None None] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:35:42.911413 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.911722 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.912041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.912367 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.912752 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.913082 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.913248 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a42f9b0a-9fbc-4fb3-8d76-c399cdbcb73e None None] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:35:42.913656 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.913998 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.914322 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.914642 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.914984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.915153 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO dbcounter [None req-a42f9b0a-9fbc-4fb3-8d76-c399cdbcb73e None None] Registered counter for database nova_cell0 May 25 07:35:42.915307 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.915613 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.915935 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.916254 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.916602 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.916932 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.917254 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.917589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.917936 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.918290 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.918615 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.918934 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.919102 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO dbcounter [None req-a42f9b0a-9fbc-4fb3-8d76-c399cdbcb73e None None] Registered counter for database nova_cell1 May 25 07:35:42.919266 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.919563 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.919929 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.920237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.920576 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.921148 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.921337 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.921549 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.921951 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.922278 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.922495 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.922895 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.923485 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.923812 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.924138 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.924462 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.924831 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.925180 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.925508 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.925831 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.926128 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_db.sqlalchemy.engines [None req-a42f9b0a-9fbc-4fb3-8d76-c399cdbcb73e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 07:35:42.926231 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.926465 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.927035 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.927359 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.927707 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.928038 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.928400 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.928513 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_db.sqlalchemy.engines [None req-a42f9b0a-9fbc-4fb3-8d76-c399cdbcb73e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 07:35:42.928756 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.929081 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.929415 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.929727 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.930039 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.930357 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.930672 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.930982 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.931312 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.931626 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.931943 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.932404 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.932606 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.933147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.933508 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.933687 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writer thread running {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 07:35:42.933835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.934175 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.934513 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.934838 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.935152 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.935508 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.935825 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.936139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.936251 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writer thread running {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 07:35:42.936463 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.936807 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.937119 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.937432 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.937754 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.938073 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.938960 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.939542 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.939888 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.940228 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.940571 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.940889 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.941226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.941547 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.941862 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.942175 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.942487 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.942826 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.943146 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.943469 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.943794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.944107 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.944424 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.944763 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.945082 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.945452 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.945807 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.946122 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.946433 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.946756 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.947076 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.947405 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.947732 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.948047 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.948402 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.948751 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.949300 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.949667 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.950002 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.950344 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.950685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.951002 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.951315 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.951631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.951967 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.952289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.952635 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.952957 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.953276 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.953593 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.954076 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.954606 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.954937 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.955263 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.955585 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.955906 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.956226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.956570 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.956935 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.957289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.957621 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.957951 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.958273 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.958598 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.958917 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.959260 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.959579 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.959897 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.960221 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.960631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.960904 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.961219 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.961655 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.961979 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.962309 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.962639 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.962958 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.963291 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.963624 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.963944 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.964297 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.964644 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.965005 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.965353 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.965693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.966029 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.966345 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.966661 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.966975 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.967296 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.967626 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.967949 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.968260 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.968599 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.968920 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.969238 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.970146 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.970787 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.971045 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.971369 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.971689 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.972003 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.972320 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.972672 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.972992 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.973307 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.973626 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.973941 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.974255 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.974565 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.974904 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.975220 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.975563 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.975907 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.976234 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.976591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.977180 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.977513 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.977855 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.978170 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.978503 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.978829 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.979149 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.979494 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.979813 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.980135 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.980454 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.980896 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.981142 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.981462 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.981800 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.982134 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.982452 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.982784 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.983110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.983443 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.983781 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.984102 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.984444 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.984789 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.985374 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.985886 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.986215 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.986557 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.986888 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.987216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.987556 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.987898 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.988219 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.988579 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.988920 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.989277 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.989602 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.989980 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.990318 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.990646 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.990968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.991281 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 25 07:35:42.991532 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=124674) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 25 07:35:43.053753 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO dbcounter [None req-2b82fffd-15e7-4587-8d10-a63d13651fd0 None None] Registered counter for database nova_api May 25 07:35:43.074350 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_db.sqlalchemy.engines [None req-2b82fffd-15e7-4587-8d10-a63d13651fd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 07:35:43.082239 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writer thread running {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 07:35:43.088326 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO dbcounter [None req-a42f9b0a-9fbc-4fb3-8d76-c399cdbcb73e None None] Registered counter for database nova_cell0 May 25 07:35:43.095788 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_db.sqlalchemy.engines [None req-a42f9b0a-9fbc-4fb3-8d76-c399cdbcb73e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124675) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 07:35:43.100295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writer thread running {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 07:35:43.141179 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.context [None req-2b82fffd-15e7-4587-8d10-a63d13651fd0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),b54eaccb-ae13-4b47-bdce-eca4e8d593ce(cell1) {{(pid=124674) load_cells /opt/stack/nova/nova/context.py:464}} May 25 07:35:43.146134 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2b82fffd-15e7-4587-8d10-a63d13651fd0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:35:43.147747 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2b82fffd-15e7-4587-8d10-a63d13651fd0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:35:43.148586 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2b82fffd-15e7-4587-8d10-a63d13651fd0 None None] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:35:43.150566 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2b82fffd-15e7-4587-8d10-a63d13651fd0 None None] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:35:43.152599 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO dbcounter [None req-2b82fffd-15e7-4587-8d10-a63d13651fd0 None None] Registered counter for database nova_cell0 May 25 07:35:43.156573 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO dbcounter [None req-2b82fffd-15e7-4587-8d10-a63d13651fd0 None None] Registered counter for database nova_cell1 May 25 07:35:43.164840 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_db.sqlalchemy.engines [None req-2b82fffd-15e7-4587-8d10-a63d13651fd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 07:35:43.166577 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_db.sqlalchemy.engines [None req-2b82fffd-15e7-4587-8d10-a63d13651fd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 07:35:43.172125 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writer thread running {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 07:35:43.175299 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writer thread running {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 07:35:43.331059 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO dbcounter [None req-2b82fffd-15e7-4587-8d10-a63d13651fd0 None None] Registered counter for database nova_cell0 May 25 07:35:43.337923 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_db.sqlalchemy.engines [None req-2b82fffd-15e7-4587-8d10-a63d13651fd0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=124674) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 25 07:35:43.342381 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writer thread running {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 25 07:35:43.421233 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: WARNING keystonemiddleware.auth_token [None req-a42f9b0a-9fbc-4fb3-8d76-c399cdbcb73e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 07:35:43.428809 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: WARNING keystonemiddleware.auth_token [None req-a42f9b0a-9fbc-4fb3-8d76-c399cdbcb73e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 07:35:43.687188 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: WARNING keystonemiddleware.auth_token [None req-2b82fffd-15e7-4587-8d10-a63d13651fd0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 07:35:43.694979 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: WARNING keystonemiddleware.auth_token [None req-2b82fffd-15e7-4587-8d10-a63d13651fd0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 07:35:43.769562 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: WARNING keystonemiddleware.auth_token [None req-a42f9b0a-9fbc-4fb3-8d76-c399cdbcb73e None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 07:35:43.775865 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: WARNING keystonemiddleware.auth_token [None req-a42f9b0a-9fbc-4fb3-8d76-c399cdbcb73e None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 07:35:43.781426 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55b11608e9c0 pid: 124675 (default app) May 25 07:35:44.046996 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: WARNING keystonemiddleware.auth_token [None req-2b82fffd-15e7-4587-8d10-a63d13651fd0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. May 25 07:35:44.054312 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: WARNING keystonemiddleware.auth_token [None req-2b82fffd-15e7-4587-8d10-a63d13651fd0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint May 25 07:35:44.059703 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55b11608e9c0 pid: 124674 (default app) May 25 07:36:26.150429 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=3 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:26.151894 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=3 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:26.153874 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=3 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:26.156628 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=3 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:27.390794 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-278d556f-571c-437d-82ff-78c37dd1b6b6 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Action: 'create', calling method: .version_select at 0x7fc86631fc10>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-847602854"}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:36:28.575654 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=3 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:28.576781 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=3 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:28.577929 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=3 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:28.578649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=3 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:29.476379 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-e9fbb7fd-c9f5-4781-b518-ec08585e2389 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1184176868", "imageRef": "ddc5b622-a846-425a-b8fd-7e5caef00bf8", "flavorRef": "452", "networks": [{"uuid": "393dac28-ed3c-466a-907d-db6538b59cca"}]}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:36:29.993795 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.network.neutron [None req-e9fbb7fd-c9f5-4781-b518-ec08585e2389 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] validate_networks() for [('393dac28-ed3c-466a-907d-db6538b59cca', None, None, None, None, None)] {{(pid=124674) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:36:30.251868 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-278d556f-571c-437d-82ff-78c37dd1b6b6 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 4.106966 May 25 07:36:30.252956 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 1/1] 10.222.0.24 () {60 vars in 1154 bytes} [Wed May 25 07:36:26 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 4110 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 25 07:36:30.267823 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-2a414ef4-517a-4356-b848-e95a73fe57a3 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Calling method '.version_select at 0x7fc86616cb80>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:30.447557 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-2a414ef4-517a-4356-b848-e95a73fe57a3 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/ab433baa-1dd6-4d72-9dfc-ce883b905535" status: 200 len: 344 microversion: 2.1 time: 0.178499 May 25 07:36:30.449460 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 2/2] 10.222.0.24 () {58 vars in 1244 bytes} [Wed May 25 07:36:30 2022] GET /compute/v2.1/os-volumes/ab433baa-1dd6-4d72-9dfc-ce883b905535 => generated 344 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:36:31.502280 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-d94719fc-73e3-4d4a-b440-cc551f90a7b1 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Calling method '.version_select at 0x7fc86616cd30>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:31.603871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-d94719fc-73e3-4d4a-b440-cc551f90a7b1 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/ab433baa-1dd6-4d72-9dfc-ce883b905535" status: 200 len: 344 microversion: 2.1 time: 0.145033 May 25 07:36:31.604540 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 3/3] 10.222.0.24 () {58 vars in 1244 bytes} [Wed May 25 07:36:31 2022] GET /compute/v2.1/os-volumes/ab433baa-1dd6-4d72-9dfc-ce883b905535 => generated 344 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:36:32.618591 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-3411be69-8c03-4309-917a-8c34d823dc99 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Calling method '.version_select at 0x7fc86617d310>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:32.741517 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-3411be69-8c03-4309-917a-8c34d823dc99 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/ab433baa-1dd6-4d72-9dfc-ce883b905535" status: 200 len: 345 microversion: 2.1 time: 0.127721 May 25 07:36:32.742701 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 4/4] 10.222.0.24 () {58 vars in 1244 bytes} [Wed May 25 07:36:32 2022] GET /compute/v2.1/os-volumes/ab433baa-1dd6-4d72-9dfc-ce883b905535 => generated 345 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:36:32.755318 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-aec19d65-ed3c-4edc-8986-aa75de8b097f tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Action: 'create', calling method: .version_select at 0x7fc86617d940>, body: {"snapshot": {"volume_id": "ab433baa-1dd6-4d72-9dfc-ce883b905535", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-147518160"}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:36:33.379811 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-e9fbb7fd-c9f5-4781-b518-ec08585e2389 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Flavor limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:36:33.380335 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-e9fbb7fd-c9f5-4781-b518-ec08585e2389 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Image limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:36:33.381072 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-e9fbb7fd-c9f5-4781-b518-ec08585e2389 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Flavor pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:36:33.381693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-e9fbb7fd-c9f5-4781-b518-ec08585e2389 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Image pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:36:33.382117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-e9fbb7fd-c9f5-4781-b518-ec08585e2389 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:36:33.459359 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e9fbb7fd-c9f5-4781-b518-ec08585e2389 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:33.459762 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e9fbb7fd-c9f5-4781-b518-ec08585e2389 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:33.469237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e9fbb7fd-c9f5-4781-b518-ec08585e2389 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:33.472052 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e9fbb7fd-c9f5-4781-b518-ec08585e2389 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:33.596937 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-e9fbb7fd-c9f5-4781-b518-ec08585e2389 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Getting quotas for project 39578c81fb5b4b208039318217fdb3a2. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:36:33.620694 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-aec19d65-ed3c-4edc-8986-aa75de8b097f tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] 10.222.0.24 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.869250 May 25 07:36:33.621370 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 5/5] 10.222.0.24 () {60 vars in 1161 bytes} [Wed May 25 07:36:32 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:36:33.621482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-e9fbb7fd-c9f5-4781-b518-ec08585e2389 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Getting quotas for user 107da1af788341e4817a7038495f050c and project 39578c81fb5b4b208039318217fdb3a2. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:36:33.631717 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4b8550d4-13f6-41ea-a764-273919e94ac3 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Calling method '.version_select at 0x7fc86617dd30>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:33.657002 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-e9fbb7fd-c9f5-4781-b518-ec08585e2389 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Going to run 1 instances... {{(pid=124674) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:36:33.662341 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-e9fbb7fd-c9f5-4781-b518-ec08585e2389 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddc5b622-a846-425a-b8fd-7e5caef00bf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:36:33.784416 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4b8550d4-13f6-41ea-a764-273919e94ac3 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/26d10f6b-9917-4825-90f5-0423ada77ae1" status: 200 len: 286 microversion: 2.1 time: 0.156627 May 25 07:36:33.790292 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 6/6] 10.222.0.24 () {58 vars in 1250 bytes} [Wed May 25 07:36:33 2022] GET /compute/v2.1/os-snapshots/26d10f6b-9917-4825-90f5-0423ada77ae1 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:36:33.795669 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-c07d907c-0097-4ca3-bd16-ee4bc87fe77e tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Calling method '.version_select at 0x7fc86617d550>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:33.853330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-c07d907c-0097-4ca3-bd16-ee4bc87fe77e tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.061986 May 25 07:36:33.854230 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 7/7] 10.222.0.24 () {58 vars in 1139 bytes} [Wed May 25 07:36:33 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:36:33.865886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-7273c418-0130-44f8-9cb7-fb79d86fc2b1 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Calling method '.version_select at 0x7fc86618e0d0>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:33.927235 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-7273c418-0130-44f8-9cb7-fb79d86fc2b1 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/26d10f6b-9917-4825-90f5-0423ada77ae1" status: 200 len: 286 microversion: 2.1 time: 0.065160 May 25 07:36:33.931835 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 8/8] 10.222.0.24 () {58 vars in 1250 bytes} [Wed May 25 07:36:33 2022] GET /compute/v2.1/os-snapshots/26d10f6b-9917-4825-90f5-0423ada77ae1 => generated 286 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:36:34.031992 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-e9fbb7fd-c9f5-4781-b518-ec08585e2389 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 5.464066 May 25 07:36:34.040577 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 1/9] 10.222.0.24 () {60 vars in 1146 bytes} [Wed May 25 07:36:28 2022] POST /compute/v2.1/servers => generated 380 bytes in 5477 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 07:36:34.047756 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ae6285d2-a764-4e77-ada2-0548fd120236 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:34.051422 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ae6285d2-a764-4e77-ada2-0548fd120236 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:36:34.385702 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ae6285d2-a764-4e77-ada2-0548fd120236 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:36:34.404321 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ae6285d2-a764-4e77-ada2-0548fd120236 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1215 microversion: 2.1 time: 0.363124 May 25 07:36:34.405481 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 9/10] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:36:34 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1215 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:36:34.940762 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-60810a9f-4a13-4b4c-bd76-f53cadae0a50 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Calling method '.version_select at 0x7fc86611bb80>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:35.043493 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-60810a9f-4a13-4b4c-bd76-f53cadae0a50 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/26d10f6b-9917-4825-90f5-0423ada77ae1" status: 200 len: 286 microversion: 2.1 time: 0.107760 May 25 07:36:35.044539 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 2/11] 10.222.0.24 () {58 vars in 1250 bytes} [Wed May 25 07:36:34 2022] GET /compute/v2.1/os-snapshots/26d10f6b-9917-4825-90f5-0423ada77ae1 => generated 286 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:36:35.422923 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-5b2febe5-d6ad-4566-aa58-74c5151acecf tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:35.424095 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-5b2febe5-d6ad-4566-aa58-74c5151acecf tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:36:35.618580 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-5b2febe5-d6ad-4566-aa58-74c5151acecf tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:36:35.637302 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-5b2febe5-d6ad-4566-aa58-74c5151acecf tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1215 microversion: 2.1 time: 0.212020 May 25 07:36:35.638415 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 10/12] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:36:35 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1215 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:36:36.057140 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-a7788df8-c105-4954-8e9b-90b647b51798 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Calling method '.version_select at 0x7fc86507a550>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:36.153595 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-a7788df8-c105-4954-8e9b-90b647b51798 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/26d10f6b-9917-4825-90f5-0423ada77ae1" status: 200 len: 286 microversion: 2.1 time: 0.101485 May 25 07:36:36.160447 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 3/13] 10.222.0.24 () {58 vars in 1250 bytes} [Wed May 25 07:36:36 2022] GET /compute/v2.1/os-snapshots/26d10f6b-9917-4825-90f5-0423ada77ae1 => generated 286 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:36:36.656092 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-79fc58e3-9db2-4e32-8fb2-560b3a34aad9 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:36.657467 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-79fc58e3-9db2-4e32-8fb2-560b3a34aad9 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:36:36.912040 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-79fc58e3-9db2-4e32-8fb2-560b3a34aad9 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:36:36.920360 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-79fc58e3-9db2-4e32-8fb2-560b3a34aad9 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1215 microversion: 2.1 time: 0.269006 May 25 07:36:36.925776 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 11/14] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:36:36 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1215 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:36:37.166022 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-8218391d-110f-45a4-86b7-82c8d63860d3 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Calling method '.version_select at 0x7fc86507ac10>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:37.208968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-8218391d-110f-45a4-86b7-82c8d63860d3 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/26d10f6b-9917-4825-90f5-0423ada77ae1" status: 200 len: 286 microversion: 2.1 time: 0.046811 May 25 07:36:37.209996 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 4/15] 10.222.0.24 () {58 vars in 1250 bytes} [Wed May 25 07:36:37 2022] GET /compute/v2.1/os-snapshots/26d10f6b-9917-4825-90f5-0423ada77ae1 => generated 286 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:36:37.957461 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-d7625502-6550-40d7-9381-eec05512f25e tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:37.959726 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-d7625502-6550-40d7-9381-eec05512f25e tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:36:37.985879 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d7625502-6550-40d7-9381-eec05512f25e tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:37.987220 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d7625502-6550-40d7-9381-eec05512f25e tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:37.989008 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d7625502-6550-40d7-9381-eec05512f25e tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:37.989837 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d7625502-6550-40d7-9381-eec05512f25e tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:38.225928 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-58bdd27a-5ff3-4fbb-873e-cac56ea6b225 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Calling method '.version_select at 0x7fc865021310>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:38.309199 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-58bdd27a-5ff3-4fbb-873e-cac56ea6b225 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/26d10f6b-9917-4825-90f5-0423ada77ae1" status: 200 len: 287 microversion: 2.1 time: 0.087260 May 25 07:36:38.310007 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 5/16] 10.222.0.24 () {58 vars in 1250 bytes} [Wed May 25 07:36:38 2022] GET /compute/v2.1/os-snapshots/26d10f6b-9917-4825-90f5-0423ada77ae1 => generated 287 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:36:38.324183 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-3e6575e4-2f03-4b36-a7a1-f16532f3e8e2 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Calling method '.version_select at 0x7fc86507ae50>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:38.424766 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d7625502-6550-40d7-9381-eec05512f25e tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:36:38.456427 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-d7625502-6550-40d7-9381-eec05512f25e tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1219 microversion: 2.1 time: 0.518094 May 25 07:36:38.457252 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 12/17] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:36:37 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1219 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:36:38.533501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-3e6575e4-2f03-4b36-a7a1-f16532f3e8e2 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] 10.222.0.24 "DELETE /compute/v2.1/os-snapshots/26d10f6b-9917-4825-90f5-0423ada77ae1" status: 202 len: 0 microversion: 2.1 time: 0.216095 May 25 07:36:38.534453 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 6/18] 10.222.0.24 () {58 vars in 1253 bytes} [Wed May 25 07:36:38 2022] DELETE /compute/v2.1/os-snapshots/26d10f6b-9917-4825-90f5-0423ada77ae1 => generated 0 bytes in 218 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:36:38.549827 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-f63788a8-4747-4b48-a2e3-188c6a5fac46 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Calling method '.version_select at 0x7fc8660d9160>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:38.603311 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-f63788a8-4747-4b48-a2e3-188c6a5fac46 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/26d10f6b-9917-4825-90f5-0423ada77ae1" status: 200 len: 286 microversion: 2.1 time: 0.063850 May 25 07:36:38.604058 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 13/19] 10.222.0.24 () {58 vars in 1250 bytes} [Wed May 25 07:36:38 2022] GET /compute/v2.1/os-snapshots/26d10f6b-9917-4825-90f5-0423ada77ae1 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:36:39.188616 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1a1a5dfc-2258-4396-87ee-18f68cf1e2c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-941858765", "imageRef": "ddc5b622-a846-425a-b8fd-7e5caef00bf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:36:39.293170 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.network.neutron [None req-1a1a5dfc-2258-4396-87ee-18f68cf1e2c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] validate_networks() for [('e9255b8f-85b1-4659-9bc1-7aaec6681338', None, None, None, None, None)] {{(pid=124674) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:36:39.474287 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-683ebabb-c9c3-47f5-a41e-36f39e73c0aa tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:39.474977 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-683ebabb-c9c3-47f5-a41e-36f39e73c0aa tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:36:39.489130 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-683ebabb-c9c3-47f5-a41e-36f39e73c0aa tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:39.489594 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-683ebabb-c9c3-47f5-a41e-36f39e73c0aa tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:39.490402 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-683ebabb-c9c3-47f5-a41e-36f39e73c0aa tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:39.490839 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-683ebabb-c9c3-47f5-a41e-36f39e73c0aa tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:39.764209 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-683ebabb-c9c3-47f5-a41e-36f39e73c0aa tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:36:39.773841 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-683ebabb-c9c3-47f5-a41e-36f39e73c0aa tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1219 microversion: 2.1 time: 0.303956 May 25 07:36:39.778041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 14/20] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:36:39 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1219 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:36:39.782978 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-fd8f9ff8-3eb9-4931-9998-650aee562969 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Calling method '.version_select at 0x7fc866147550>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:39.857371 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-fd8f9ff8-3eb9-4931-9998-650aee562969 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/26d10f6b-9917-4825-90f5-0423ada77ae1" status: 200 len: 286 microversion: 2.1 time: 0.078015 May 25 07:36:39.857885 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 15/21] 10.222.0.24 () {58 vars in 1250 bytes} [Wed May 25 07:36:39 2022] GET /compute/v2.1/os-snapshots/26d10f6b-9917-4825-90f5-0423ada77ae1 => generated 286 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:36:40.854134 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-1a1a5dfc-2258-4396-87ee-18f68cf1e2c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Flavor limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:36:40.854653 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-1a1a5dfc-2258-4396-87ee-18f68cf1e2c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Image limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:36:40.855299 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-1a1a5dfc-2258-4396-87ee-18f68cf1e2c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Flavor pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:36:40.855829 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-1a1a5dfc-2258-4396-87ee-18f68cf1e2c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Image pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:36:40.856458 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-1a1a5dfc-2258-4396-87ee-18f68cf1e2c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:36:40.883105 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1a1a5dfc-2258-4396-87ee-18f68cf1e2c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:40.883565 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1a1a5dfc-2258-4396-87ee-18f68cf1e2c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:40.884369 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1a1a5dfc-2258-4396-87ee-18f68cf1e2c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:40.887575 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1a1a5dfc-2258-4396-87ee-18f68cf1e2c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:40.962422 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-1a1a5dfc-2258-4396-87ee-18f68cf1e2c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Getting quotas for project d4719a4804e24f27b9427e58c5cbe13b. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:36:40.984877 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-1a1a5dfc-2258-4396-87ee-18f68cf1e2c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Getting quotas for user f90f0f6afda54e80bc319dc5bdb80ea6 and project d4719a4804e24f27b9427e58c5cbe13b. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:36:41.018459 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-1a1a5dfc-2258-4396-87ee-18f68cf1e2c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Going to run 1 instances... {{(pid=124674) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:36:41.021817 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-1a1a5dfc-2258-4396-87ee-18f68cf1e2c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddc5b622-a846-425a-b8fd-7e5caef00bf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:36:41.247816 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-6dbe518a-c0fd-409f-b2b5-a67c92dc2ee8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Action: 'create', calling method: .version_select at 0x7fc866082820>, body: {"keypair": {"name": "tempest-keypair-96530937", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBOrIKhcIo7C42BgLXDU6/ICYZmrSyAmnHRr5tiDt8+Syt1wnmgSENRRZxag90RyfEVbHrx5EfBz01BDJFoi8d5L/WpDX0kW9ZCCcghVgMGQDmtGJbOW803KegMSxzMOTmw=="}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:36:41.272251 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-1a1a5dfc-2258-4396-87ee-18f68cf1e2c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.515449 May 25 07:36:41.278095 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 7/22] 10.222.0.24 () {60 vars in 1146 bytes} [Wed May 25 07:36:38 2022] POST /compute/v2.1/servers => generated 383 bytes in 2522 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 07:36:41.306074 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-e1263c78-973c-4be0-bdfd-49e3b2a0ec50 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:41.306846 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-e1263c78-973c-4be0-bdfd-49e3b2a0ec50 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:36:41.357415 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e1263c78-973c-4be0-bdfd-49e3b2a0ec50 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:41.357876 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e1263c78-973c-4be0-bdfd-49e3b2a0ec50 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:41.358706 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e1263c78-973c-4be0-bdfd-49e3b2a0ec50 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:41.359152 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e1263c78-973c-4be0-bdfd-49e3b2a0ec50 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:41.443454 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-6dbe518a-c0fd-409f-b2b5-a67c92dc2ee8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Getting quotas for project 2d8e35800ce043acbcb027ce406ed2e7. Resources: {'key_pairs'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:36:41.475142 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-6dbe518a-c0fd-409f-b2b5-a67c92dc2ee8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Getting quotas for user 0487ea9076ee4baf8138fdc25ce02522 and project 2d8e35800ce043acbcb027ce406ed2e7. Resources: {'key_pairs'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:36:41.783944 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-6dbe518a-c0fd-409f-b2b5-a67c92dc2ee8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 1.128239 May 25 07:36:41.785117 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 16/23] 10.222.0.24 () {60 vars in 1158 bytes} [Wed May 25 07:36:40 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 1130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:36:41.790307 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-cccfa301-a0fa-4022-94c5-bb9a4be6caa9 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Calling method '.version_select at 0x7fc865fee8b0>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:41.948085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-cccfa301-a0fa-4022-94c5-bb9a4be6caa9 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] HTTP exception thrown: Snapshot 26d10f6b-9917-4825-90f5-0423ada77ae1 could not be found. May 25 07:36:41.955050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-cccfa301-a0fa-4022-94c5-bb9a4be6caa9 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Request method failure captured: May 25 07:36:41.955050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: GET /compute/v2.1/os-snapshots/26d10f6b-9917-4825-90f5-0423ada77ae1 HTTP/1.1 May 25 07:36:41.955050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:36:41.955050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:36:41.955050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:36:41.955050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:36:41.955050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:36:41.955050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:36:41.955050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:36:41.955050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:36:41.955050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijdx6mnGLNAS_d3MQhgPa8esS7KcNuz9ywC8x7lYirbuiBgDg51lQBBeflV8Bmy-Wy18FBW0fYoB-I8ESwyuZJdo009juB1ptC6SaON6A-lymgSH0dliARFNIMpwPLeDiEDMqt2tHOPMsKsbuGxk0bvwkoEqc3eIjpu03pkp8ovqkdjY May 25 07:36:41.955050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:36:41.955050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:36:41.955050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:36:41.955050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:36:41.955050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:36:41.955050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:36:41.955050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: 7b680101e6694c3a9d345c92ee378101 May 25 07:36:41.955050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-812354999 May 25 07:36:41.955050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:36:41.955050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:36:41.957711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7b680101e6694c3a9d345c92ee378101"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7b680101e6694c3a9d345c92ee378101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7b680101e6694c3a9d345c92ee378101", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7b680101e6694c3a9d345c92ee378101"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:36:41.957711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-VolumesSnapshotsTestJSON-812354999 May 25 07:36:41.957711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: 7b680101e6694c3a9d345c92ee378101 May 25 07:36:41.957711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-812354999 May 25 07:36:41.957711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-VolumesSnapshotsTestJSON-812354999-project May 25 07:36:41.957711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:36:41.957711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:36:41.957711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: fe098a4d40404eb89bd1d7b552c68654 May 25 07:36:41.957711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-VolumesSnapshotsTestJSON-812354999-project May 25 07:36:41.957711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: May 25 07:36:41.957711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Snapshot 26d10f6b-9917-4825-90f5-0423ada77ae1 could not be found. May 25 07:36:41.957711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': '26d10f6b-9917-4825-90f5-0423ada77ae1'} May 25 07:36:41.957711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:36:41.958504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:36:41.958504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 25 07:36:41.958504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 25 07:36:41.958504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 25 07:36:41.958504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 25 07:36:41.958504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 25 07:36:41.958504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 25 07:36:41.958504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 07:36:41.958504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 07:36:41.958504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 07:36:41.958504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 07:36:41.958504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 07:36:41.958504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 07:36:41.958504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 07:36:41.958504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 07:36:41.958504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 26d10f6b-9917-4825-90f5-0423ada77ae1 could not be found. (HTTP 404) (Request-ID: req-6c299c1a-2af3-47f5-93fb-e7fe15004203) May 25 07:36:41.958504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:36:41.958504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:36:41.959596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:36:41.959596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:36:41.959596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show May 25 07:36:41.959596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) May 25 07:36:41.959596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 07:36:41.959596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 07:36:41.959596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper May 25 07:36:41.959596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) May 25 07:36:41.959596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 07:36:41.959596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 07:36:41.959596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper May 25 07:36:41.959596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) May 25 07:36:41.959596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot May 25 07:36:41.959596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) May 25 07:36:41.959596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get May 25 07:36:41.959596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") May 25 07:36:41.959596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 07:36:41.959596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 07:36:41.959596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 07:36:41.961019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 07:36:41.961019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 07:36:41.961019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 07:36:41.961019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 07:36:41.961019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 07:36:41.961019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 26d10f6b-9917-4825-90f5-0423ada77ae1 could not be found. May 25 07:36:41.961019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:36:41.961019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:36:41.961019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:36:41.961019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:36:41.961019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:36:41.961019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:36:41.961019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:36:41.961019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:36:41.961019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 07:36:41.961019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 07:36:41.961019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:36:41.961019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:36:41.961019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show May 25 07:36:41.961019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:36:41.962224 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 26d10f6b-9917-4825-90f5-0423ada77ae1 could not be found. May 25 07:36:41.962224 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:36:41.962224 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:36:41.962224 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:36:41.962224 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:36:41.962224 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:36:41.962224 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:36:41.962224 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:36:41.962224 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:36:41.962224 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 26d10f6b-9917-4825-90f5-0423ada77ae1 could not be found. May 25 07:36:41.962224 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:36:41.962224 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-cccfa301-a0fa-4022-94c5-bb9a4be6caa9 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Returning 404 to user: Snapshot 26d10f6b-9917-4825-90f5-0423ada77ae1 could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:36:41.976279 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-cccfa301-a0fa-4022-94c5-bb9a4be6caa9 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] 10.222.0.24 "GET /compute/v2.1/os-snapshots/26d10f6b-9917-4825-90f5-0423ada77ae1" status: 404 len: 111 microversion: 2.1 time: 0.170531 May 25 07:36:41.979896 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 17/24] 10.222.0.24 () {58 vars in 1250 bytes} [Wed May 25 07:36:41 2022] GET /compute/v2.1/os-snapshots/26d10f6b-9917-4825-90f5-0423ada77ae1 => generated 111 bytes in 194 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:36:42.004152 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-0f7c40a6-0a08-4437-89e3-bcf667418111 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:42.006279 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-0f7c40a6-0a08-4437-89e3-bcf667418111 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:36:42.183383 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-e1263c78-973c-4be0-bdfd-49e3b2a0ec50 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:36:42.242682 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-e1263c78-973c-4be0-bdfd-49e3b2a0ec50 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1267 microversion: 2.1 time: 0.958819 May 25 07:36:42.256519 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 8/25] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:36:41 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1267 bytes in 969 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:36:42.266329 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-0f7c40a6-0a08-4437-89e3-bcf667418111 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:36:42.278549 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-0f7c40a6-0a08-4437-89e3-bcf667418111 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1221 microversion: 2.1 time: 0.285953 May 25 07:36:42.283539 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-18fd0f37-b2e7-4fa5-907e-73e0ba05af53 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Calling method '.version_select at 0x7fc864fa2d30>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:42.290364 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 18/26] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:36:41 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1221 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:36:42.599186 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8c2a662d-b092-4c7e-91ba-99bbe77246a1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1752381632", "imageRef": "ddc5b622-a846-425a-b8fd-7e5caef00bf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:36:42.927459 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.network.neutron [None req-8c2a662d-b092-4c7e-91ba-99bbe77246a1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] validate_networks() for [('e9255b8f-85b1-4659-9bc1-7aaec6681338', None, None, None, None, None)] {{(pid=124675) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:36:43.111813 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-18fd0f37-b2e7-4fa5-907e-73e0ba05af53 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/ab433baa-1dd6-4d72-9dfc-ce883b905535" status: 202 len: 0 microversion: 2.1 time: 0.862006 May 25 07:36:43.112805 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 9/27] 10.222.0.24 () {58 vars in 1247 bytes} [Wed May 25 07:36:42 2022] DELETE /compute/v2.1/os-volumes/ab433baa-1dd6-4d72-9dfc-ce883b905535 => generated 0 bytes in 864 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:36:43.120907 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-a0b3c970-86ce-4d6b-afbb-559e4a2bd771 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Calling method '.version_select at 0x7fc864fd2d30>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:43.411320 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-a0b3c970-86ce-4d6b-afbb-559e4a2bd771 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/ab433baa-1dd6-4d72-9dfc-ce883b905535" status: 200 len: 344 microversion: 2.1 time: 0.293901 May 25 07:36:43.412332 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 10/28] 10.222.0.24 () {58 vars in 1244 bytes} [Wed May 25 07:36:43 2022] GET /compute/v2.1/os-volumes/ab433baa-1dd6-4d72-9dfc-ce883b905535 => generated 344 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:36:43.418819 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-b25f5359-79c1-44d4-85ee-74f07d6577eb tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:43.421678 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-b25f5359-79c1-44d4-85ee-74f07d6577eb tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:36:43.460747 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b25f5359-79c1-44d4-85ee-74f07d6577eb tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:43.461183 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b25f5359-79c1-44d4-85ee-74f07d6577eb tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:43.466963 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b25f5359-79c1-44d4-85ee-74f07d6577eb tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:43.467459 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b25f5359-79c1-44d4-85ee-74f07d6577eb tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:43.766601 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-b25f5359-79c1-44d4-85ee-74f07d6577eb tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:36:43.777050 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-b25f5359-79c1-44d4-85ee-74f07d6577eb tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1273 microversion: 2.1 time: 0.363326 May 25 07:36:43.777854 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 11/29] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:36:43 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1273 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:36:44.425853 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-64f57a4d-a89d-409c-89e6-50bbff9fec78 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Calling method '.version_select at 0x7fc864f77700>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:44.481293 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-64f57a4d-a89d-409c-89e6-50bbff9fec78 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] HTTP exception thrown: Volume ab433baa-1dd6-4d72-9dfc-ce883b905535 could not be found. May 25 07:36:44.486237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-64f57a4d-a89d-409c-89e6-50bbff9fec78 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Request method failure captured: May 25 07:36:44.486237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: GET /compute/v2.1/os-volumes/ab433baa-1dd6-4d72-9dfc-ce883b905535 HTTP/1.1 May 25 07:36:44.486237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:36:44.486237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:36:44.486237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:36:44.486237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:36:44.486237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:36:44.486237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:36:44.486237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:36:44.486237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:36:44.486237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdx6mnGLNAS_d3MQhgPa8esS7KcNuz9ywC8x7lYirbuiBgDg51lQBBeflV8Bmy-Wy18FBW0fYoB-I8ESwyuZJdo009juB1ptC6SaON6A-lymgSH0dliARFNIMpwPLeDiEDMqt2tHOPMsKsbuGxk0bvwkoEqc3eIjpu03pkp8ovqkdjY May 25 07:36:44.486237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:36:44.486237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:36:44.486237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:36:44.486237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:36:44.486237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:36:44.486237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:36:44.486237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: 7b680101e6694c3a9d345c92ee378101 May 25 07:36:44.486237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-812354999 May 25 07:36:44.486237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:36:44.486237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:36:44.487627 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7b680101e6694c3a9d345c92ee378101"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7b680101e6694c3a9d345c92ee378101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7b680101e6694c3a9d345c92ee378101", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7b680101e6694c3a9d345c92ee378101"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:36:44.487627 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-VolumesSnapshotsTestJSON-812354999 May 25 07:36:44.487627 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: 7b680101e6694c3a9d345c92ee378101 May 25 07:36:44.487627 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-812354999 May 25 07:36:44.487627 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-VolumesSnapshotsTestJSON-812354999-project May 25 07:36:44.487627 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:36:44.487627 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:36:44.487627 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: fe098a4d40404eb89bd1d7b552c68654 May 25 07:36:44.487627 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-VolumesSnapshotsTestJSON-812354999-project May 25 07:36:44.487627 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: May 25 07:36:44.487627 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Volume ab433baa-1dd6-4d72-9dfc-ce883b905535 could not be found. May 25 07:36:44.487627 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': 'ab433baa-1dd6-4d72-9dfc-ce883b905535'} May 25 07:36:44.487627 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:36:44.488448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:36:44.488448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 07:36:44.488448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 07:36:44.488448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 07:36:44.488448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 07:36:44.488448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 07:36:44.488448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 07:36:44.488448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 07:36:44.488448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 07:36:44.488448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 07:36:44.488448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 07:36:44.488448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 07:36:44.488448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 07:36:44.488448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 07:36:44.488448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 07:36:44.488448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab433baa-1dd6-4d72-9dfc-ce883b905535 could not be found. (HTTP 404) (Request-ID: req-f377b213-bbd6-4977-94df-3dc7ca9cdcdc) May 25 07:36:44.488448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:36:44.488448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:36:44.488448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:36:44.489591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:36:44.489591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 07:36:44.489591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 07:36:44.489591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 07:36:44.489591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 07:36:44.489591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 07:36:44.489591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 07:36:44.489591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 07:36:44.489591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 07:36:44.489591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 07:36:44.489591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 07:36:44.489591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 07:36:44.489591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 07:36:44.489591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 07:36:44.489591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 07:36:44.489591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 07:36:44.489591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 07:36:44.489591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 07:36:44.489591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 07:36:44.490891 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 07:36:44.490891 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 07:36:44.490891 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 07:36:44.490891 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 07:36:44.490891 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab433baa-1dd6-4d72-9dfc-ce883b905535 could not be found. May 25 07:36:44.490891 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:36:44.490891 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:36:44.490891 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:36:44.490891 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:36:44.490891 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:36:44.490891 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:36:44.490891 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:36:44.490891 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:36:44.490891 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 07:36:44.490891 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 07:36:44.490891 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:36:44.490891 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:36:44.490891 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 07:36:44.490891 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:36:44.491999 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab433baa-1dd6-4d72-9dfc-ce883b905535 could not be found. May 25 07:36:44.491999 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:36:44.491999 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:36:44.491999 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:36:44.491999 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:36:44.491999 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:36:44.491999 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:36:44.491999 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:36:44.491999 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:36:44.491999 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab433baa-1dd6-4d72-9dfc-ce883b905535 could not be found. May 25 07:36:44.491999 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:36:44.493512 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-64f57a4d-a89d-409c-89e6-50bbff9fec78 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Returning 404 to user: Volume ab433baa-1dd6-4d72-9dfc-ce883b905535 could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:36:44.494652 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-64f57a4d-a89d-409c-89e6-50bbff9fec78 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/ab433baa-1dd6-4d72-9dfc-ce883b905535" status: 404 len: 109 microversion: 2.1 time: 0.075315 May 25 07:36:44.495359 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 12/30] 10.222.0.24 () {58 vars in 1244 bytes} [Wed May 25 07:36:44 2022] GET /compute/v2.1/os-volumes/ab433baa-1dd6-4d72-9dfc-ce883b905535 => generated 109 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 07:36:44.517517 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-5a1d442c-99c3-4cee-a42f-b81fd519cd41 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Calling method '.version_select at 0x7fc86507aee0>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:44.588366 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-5a1d442c-99c3-4cee-a42f-b81fd519cd41 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] HTTP exception thrown: Volume ab433baa-1dd6-4d72-9dfc-ce883b905535 could not be found. May 25 07:36:44.595376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-5a1d442c-99c3-4cee-a42f-b81fd519cd41 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Request method failure captured: May 25 07:36:44.595376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: DELETE /compute/v2.1/os-volumes/ab433baa-1dd6-4d72-9dfc-ce883b905535 HTTP/1.1 May 25 07:36:44.595376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:36:44.595376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:36:44.595376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:36:44.595376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:36:44.595376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:36:44.595376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:36:44.595376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:36:44.595376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:36:44.595376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdx6mnGLNAS_d3MQhgPa8esS7KcNuz9ywC8x7lYirbuiBgDg51lQBBeflV8Bmy-Wy18FBW0fYoB-I8ESwyuZJdo009juB1ptC6SaON6A-lymgSH0dliARFNIMpwPLeDiEDMqt2tHOPMsKsbuGxk0bvwkoEqc3eIjpu03pkp8ovqkdjY May 25 07:36:44.595376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:36:44.595376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:36:44.595376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:36:44.595376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:36:44.595376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:36:44.595376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:36:44.595376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: 7b680101e6694c3a9d345c92ee378101 May 25 07:36:44.595376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-812354999 May 25 07:36:44.595376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:36:44.595376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:36:44.596769 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7b680101e6694c3a9d345c92ee378101"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7b680101e6694c3a9d345c92ee378101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7b680101e6694c3a9d345c92ee378101", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7b680101e6694c3a9d345c92ee378101"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:36:44.596769 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-VolumesSnapshotsTestJSON-812354999 May 25 07:36:44.596769 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: 7b680101e6694c3a9d345c92ee378101 May 25 07:36:44.596769 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-812354999 May 25 07:36:44.596769 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-VolumesSnapshotsTestJSON-812354999-project May 25 07:36:44.596769 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:36:44.596769 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:36:44.596769 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: fe098a4d40404eb89bd1d7b552c68654 May 25 07:36:44.596769 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-VolumesSnapshotsTestJSON-812354999-project May 25 07:36:44.596769 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: May 25 07:36:44.596769 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Volume ab433baa-1dd6-4d72-9dfc-ce883b905535 could not be found. May 25 07:36:44.596769 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': 'ab433baa-1dd6-4d72-9dfc-ce883b905535'} May 25 07:36:44.596769 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:36:44.597622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:36:44.597622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 07:36:44.597622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 07:36:44.597622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 07:36:44.597622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 07:36:44.597622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 07:36:44.597622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 07:36:44.597622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 07:36:44.597622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 07:36:44.597622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 07:36:44.597622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 07:36:44.597622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 07:36:44.597622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 07:36:44.597622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 07:36:44.597622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 07:36:44.597622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab433baa-1dd6-4d72-9dfc-ce883b905535 could not be found. (HTTP 404) (Request-ID: req-04a329e6-91b3-4cbc-92d2-65f020ad4b1b) May 25 07:36:44.597622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:36:44.597622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:36:44.597622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:36:44.598748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:36:44.598748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 25 07:36:44.598748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 25 07:36:44.598748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 07:36:44.598748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 07:36:44.598748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 07:36:44.598748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 07:36:44.598748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 07:36:44.598748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 07:36:44.598748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 07:36:44.598748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 07:36:44.598748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 07:36:44.598748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 07:36:44.598748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 07:36:44.598748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 07:36:44.598748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 07:36:44.598748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 07:36:44.598748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 07:36:44.598748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 07:36:44.599875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 07:36:44.599875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 07:36:44.599875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 07:36:44.599875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 07:36:44.599875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab433baa-1dd6-4d72-9dfc-ce883b905535 could not be found. May 25 07:36:44.599875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:36:44.599875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:36:44.599875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:36:44.599875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:36:44.599875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:36:44.599875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:36:44.599875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:36:44.599875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:36:44.599875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 07:36:44.599875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 07:36:44.599875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:36:44.599875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:36:44.599875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 25 07:36:44.599875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:36:44.603412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab433baa-1dd6-4d72-9dfc-ce883b905535 could not be found. May 25 07:36:44.603412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:36:44.603412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:36:44.603412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:36:44.603412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:36:44.603412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:36:44.603412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:36:44.603412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:36:44.603412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:36:44.603412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab433baa-1dd6-4d72-9dfc-ce883b905535 could not be found. May 25 07:36:44.603412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:36:44.603412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-5a1d442c-99c3-4cee-a42f-b81fd519cd41 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Returning 404 to user: Volume ab433baa-1dd6-4d72-9dfc-ce883b905535 could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:36:44.603412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-5a1d442c-99c3-4cee-a42f-b81fd519cd41 tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/ab433baa-1dd6-4d72-9dfc-ce883b905535" status: 404 len: 109 microversion: 2.1 time: 0.088274 May 25 07:36:44.603412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 13/31] 10.222.0.24 () {58 vars in 1247 bytes} [Wed May 25 07:36:44 2022] DELETE /compute/v2.1/os-volumes/ab433baa-1dd6-4d72-9dfc-ce883b905535 => generated 109 bytes in 89 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 07:36:44.605793 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c9525177-d21e-43f1-9f25-3d8ad967398b tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Calling method '.version_select at 0x7fc864f771f0>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:44.692467 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-c9525177-d21e-43f1-9f25-3d8ad967398b tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] HTTP exception thrown: Volume ab433baa-1dd6-4d72-9dfc-ce883b905535 could not be found. May 25 07:36:44.694482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c9525177-d21e-43f1-9f25-3d8ad967398b tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Request method failure captured: May 25 07:36:44.694482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: GET /compute/v2.1/os-volumes/ab433baa-1dd6-4d72-9dfc-ce883b905535 HTTP/1.1 May 25 07:36:44.694482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:36:44.694482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:36:44.694482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:36:44.694482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:36:44.694482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:36:44.694482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:36:44.694482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:36:44.694482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:36:44.694482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdx6mnGLNAS_d3MQhgPa8esS7KcNuz9ywC8x7lYirbuiBgDg51lQBBeflV8Bmy-Wy18FBW0fYoB-I8ESwyuZJdo009juB1ptC6SaON6A-lymgSH0dliARFNIMpwPLeDiEDMqt2tHOPMsKsbuGxk0bvwkoEqc3eIjpu03pkp8ovqkdjY May 25 07:36:44.694482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:36:44.694482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:36:44.694482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:36:44.694482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:36:44.694482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:36:44.694482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:36:44.694482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: 7b680101e6694c3a9d345c92ee378101 May 25 07:36:44.694482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-812354999 May 25 07:36:44.694482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:36:44.694482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:36:44.695644 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7b680101e6694c3a9d345c92ee378101"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/7b680101e6694c3a9d345c92ee378101"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_7b680101e6694c3a9d345c92ee378101", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/7b680101e6694c3a9d345c92ee378101"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:36:44.695644 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-VolumesSnapshotsTestJSON-812354999 May 25 07:36:44.695644 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: 7b680101e6694c3a9d345c92ee378101 May 25 07:36:44.695644 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-812354999 May 25 07:36:44.695644 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-VolumesSnapshotsTestJSON-812354999-project May 25 07:36:44.695644 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:36:44.695644 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:36:44.695644 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: fe098a4d40404eb89bd1d7b552c68654 May 25 07:36:44.695644 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-VolumesSnapshotsTestJSON-812354999-project May 25 07:36:44.695644 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: May 25 07:36:44.695644 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Volume ab433baa-1dd6-4d72-9dfc-ce883b905535 could not be found. May 25 07:36:44.695644 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': 'ab433baa-1dd6-4d72-9dfc-ce883b905535'} May 25 07:36:44.695644 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:36:44.696274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:36:44.696274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 07:36:44.696274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 07:36:44.696274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 07:36:44.696274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 07:36:44.696274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 07:36:44.696274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 07:36:44.696274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 07:36:44.696274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 07:36:44.696274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 07:36:44.696274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 07:36:44.696274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 07:36:44.696274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 07:36:44.696274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 07:36:44.696274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 07:36:44.696274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ab433baa-1dd6-4d72-9dfc-ce883b905535 could not be found. (HTTP 404) (Request-ID: req-d9a06da4-9365-43f5-bc48-8177e953c323) May 25 07:36:44.696274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:36:44.696274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:36:44.696274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:36:44.697213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:36:44.697213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 07:36:44.697213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 07:36:44.697213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 07:36:44.697213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 07:36:44.697213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 07:36:44.697213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 07:36:44.697213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 07:36:44.697213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 07:36:44.697213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 07:36:44.697213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 07:36:44.697213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 07:36:44.697213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 07:36:44.697213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 07:36:44.697213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 07:36:44.697213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 07:36:44.697213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 07:36:44.697213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 07:36:44.697213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 07:36:44.698258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 07:36:44.698258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 07:36:44.698258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 07:36:44.698258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 07:36:44.698258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ab433baa-1dd6-4d72-9dfc-ce883b905535 could not be found. May 25 07:36:44.698258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:36:44.698258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:36:44.698258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:36:44.698258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:36:44.698258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:36:44.698258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:36:44.698258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:36:44.698258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:36:44.698258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 07:36:44.698258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 07:36:44.698258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:36:44.698258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:36:44.698258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 07:36:44.698258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:36:44.703008 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ab433baa-1dd6-4d72-9dfc-ce883b905535 could not be found. May 25 07:36:44.703008 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:36:44.703008 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:36:44.703008 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:36:44.703008 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:36:44.703008 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:36:44.703008 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:36:44.703008 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:36:44.703008 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:36:44.703008 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ab433baa-1dd6-4d72-9dfc-ce883b905535 could not be found. May 25 07:36:44.703008 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:36:44.703008 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c9525177-d21e-43f1-9f25-3d8ad967398b tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] Returning 404 to user: Volume ab433baa-1dd6-4d72-9dfc-ce883b905535 could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:36:44.703008 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c9525177-d21e-43f1-9f25-3d8ad967398b tempest-VolumesSnapshotsTestJSON-812354999 tempest-VolumesSnapshotsTestJSON-812354999-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/ab433baa-1dd6-4d72-9dfc-ce883b905535" status: 404 len: 109 microversion: 2.1 time: 0.094346 May 25 07:36:44.703008 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 14/32] 10.222.0.24 () {58 vars in 1244 bytes} [Wed May 25 07:36:44 2022] GET /compute/v2.1/os-volumes/ab433baa-1dd6-4d72-9dfc-ce883b905535 => generated 109 bytes in 97 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 07:36:44.797123 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-92da6521-8e6c-4d38-af7c-6e9f1ac379ab tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:44.797661 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-92da6521-8e6c-4d38-af7c-6e9f1ac379ab tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:36:44.810924 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-92da6521-8e6c-4d38-af7c-6e9f1ac379ab tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:44.811303 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-92da6521-8e6c-4d38-af7c-6e9f1ac379ab tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:44.812757 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-92da6521-8e6c-4d38-af7c-6e9f1ac379ab tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:44.813210 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-92da6521-8e6c-4d38-af7c-6e9f1ac379ab tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:45.751103 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-92da6521-8e6c-4d38-af7c-6e9f1ac379ab tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:36:45.762579 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-92da6521-8e6c-4d38-af7c-6e9f1ac379ab tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1273 microversion: 2.1 time: 0.969976 May 25 07:36:45.769297 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 15/33] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:36:44 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1273 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:36:46.245034 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-8c2a662d-b092-4c7e-91ba-99bbe77246a1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Flavor limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:36:46.245542 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-8c2a662d-b092-4c7e-91ba-99bbe77246a1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Image limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:36:46.246014 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-8c2a662d-b092-4c7e-91ba-99bbe77246a1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Flavor pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:36:46.246663 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-8c2a662d-b092-4c7e-91ba-99bbe77246a1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Image pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:36:46.247237 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-8c2a662d-b092-4c7e-91ba-99bbe77246a1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:36:46.272566 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8c2a662d-b092-4c7e-91ba-99bbe77246a1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:46.273920 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8c2a662d-b092-4c7e-91ba-99bbe77246a1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:46.277076 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8c2a662d-b092-4c7e-91ba-99bbe77246a1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:46.279397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8c2a662d-b092-4c7e-91ba-99bbe77246a1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:46.563833 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-8c2a662d-b092-4c7e-91ba-99bbe77246a1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Getting quotas for project d4719a4804e24f27b9427e58c5cbe13b. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:36:46.563833 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-8c2a662d-b092-4c7e-91ba-99bbe77246a1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Getting quotas for user f90f0f6afda54e80bc319dc5bdb80ea6 and project d4719a4804e24f27b9427e58c5cbe13b. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:36:46.563833 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-8c2a662d-b092-4c7e-91ba-99bbe77246a1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Going to run 1 instances... {{(pid=124675) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:36:46.564928 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-8c2a662d-b092-4c7e-91ba-99bbe77246a1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddc5b622-a846-425a-b8fd-7e5caef00bf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:36:46.565039 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-de4d91e5-e2b8-466d-ac91-cc695ebab13c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Action: 'create', calling method: .version_select at 0x7fc86507a550>, body: {"keypair": {"name": "tempest-keypair-1252439530", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLOOUgD4912+/+lN6H9N3Mb+CV6z16G/iD6A5T/aVVVVPsOuxNcyIeAKV0ecrvHaB0HwYJx6eD9wwXTd70EKtYx87C9nYsKHSbAFBLJcgAV/34CZkci6fcakPKhKSVlHgw=="}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:36:46.565039 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-de4d91e5-e2b8-466d-ac91-cc695ebab13c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Getting quotas for project 294afe2c36184564a80fb6bef7b32359. Resources: {'key_pairs'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:36:46.565039 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-de4d91e5-e2b8-466d-ac91-cc695ebab13c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Getting quotas for user 28d83ef95cda448dbd72acbd13a5f008 and project 294afe2c36184564a80fb6bef7b32359. Resources: {'key_pairs'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:36:47.083545 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-de4d91e5-e2b8-466d-ac91-cc695ebab13c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 1.312692 May 25 07:36:47.094244 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 16/34] 10.222.0.24 () {60 vars in 1158 bytes} [Wed May 25 07:36:45 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 1315 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:36:47.094967 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-8c2a662d-b092-4c7e-91ba-99bbe77246a1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.507971 May 25 07:36:47.094967 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 19/35] 10.222.0.24 () {60 vars in 1146 bytes} [Wed May 25 07:36:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 4512 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 07:36:47.105724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-e321deee-3a15-46c5-9ef0-5304acffcb55 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:47.112085 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-e321deee-3a15-46c5-9ef0-5304acffcb55 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:36:47.137357 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e321deee-3a15-46c5-9ef0-5304acffcb55 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:47.141448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e321deee-3a15-46c5-9ef0-5304acffcb55 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:47.145855 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e321deee-3a15-46c5-9ef0-5304acffcb55 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:47.145855 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e321deee-3a15-46c5-9ef0-5304acffcb55 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:47.237251 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-263666ee-fbfa-4218-9caf-884c979f1483 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Action: 'create', calling method: .version_select at 0x7fc8656ec430>, body: {"keypair": {"name": "tempest-keypair-1139576538", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBE8Y66AuH0lXy+a9kAPfY4IHLBcxvIjXjF64GLEslZ/YRDc7GL0DdNUai+nayshfdxroZpRqK4h0l0c+5+bGMuUF5w//mIwIO5eVhFw26BKZzUnFo7EXHDNgFRRAAM/WYw=="}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:36:47.278225 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-263666ee-fbfa-4218-9caf-884c979f1483 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Getting quotas for project c4406d5d0e2347f1b96c34496f5ba5ae. Resources: {'key_pairs'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:36:47.294215 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-263666ee-fbfa-4218-9caf-884c979f1483 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Getting quotas for user 18eb8b615526451498d3adc382d5a410 and project c4406d5d0e2347f1b96c34496f5ba5ae. Resources: {'key_pairs'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:36:47.467082 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-263666ee-fbfa-4218-9caf-884c979f1483 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.367974 May 25 07:36:47.480248 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 20/36] 10.222.0.24 () {62 vars in 1199 bytes} [Wed May 25 07:36:47 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 379 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 25 07:36:47.481033 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-c705ab7a-7477-48fa-81a9-0305cb04f781 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:47.481796 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-c705ab7a-7477-48fa-81a9-0305cb04f781 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:36:47.990631 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-c705ab7a-7477-48fa-81a9-0305cb04f781 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:36:48.015214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-c705ab7a-7477-48fa-81a9-0305cb04f781 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1222 microversion: 2.1 time: 0.543443 May 25 07:36:48.050084 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 21/37] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:36:47 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1222 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:36:49.067747 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-5bbf3ee4-83da-4eca-bf61-a5877615de26 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:49.068422 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-5bbf3ee4-83da-4eca-bf61-a5877615de26 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:36:49.079358 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5bbf3ee4-83da-4eca-bf61-a5877615de26 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:49.080247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5bbf3ee4-83da-4eca-bf61-a5877615de26 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:49.081266 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5bbf3ee4-83da-4eca-bf61-a5877615de26 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:49.082205 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5bbf3ee4-83da-4eca-bf61-a5877615de26 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:49.330881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-5bbf3ee4-83da-4eca-bf61-a5877615de26 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:36:49.341695 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-5bbf3ee4-83da-4eca-bf61-a5877615de26 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1226 microversion: 2.1 time: 0.277997 May 25 07:36:49.357449 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 22/38] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:36:49 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1226 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:36:49.717499 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-e321deee-3a15-46c5-9ef0-5304acffcb55 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:36:49.738438 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-e321deee-3a15-46c5-9ef0-5304acffcb55 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1315 microversion: 2.1 time: 2.644902 May 25 07:36:49.740101 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 17/39] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:36:47 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1315 bytes in 2650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:36:50.364467 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-38963aa0-c6ac-4c47-9ca0-6ea2285e4a65 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:50.372583 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-38963aa0-c6ac-4c47-9ca0-6ea2285e4a65 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:36:50.391065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-38963aa0-c6ac-4c47-9ca0-6ea2285e4a65 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:50.402333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-38963aa0-c6ac-4c47-9ca0-6ea2285e4a65 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:50.407025 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-38963aa0-c6ac-4c47-9ca0-6ea2285e4a65 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:50.408000 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-38963aa0-c6ac-4c47-9ca0-6ea2285e4a65 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:50.702889 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-38963aa0-c6ac-4c47-9ca0-6ea2285e4a65 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:36:50.723361 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-38963aa0-c6ac-4c47-9ca0-6ea2285e4a65 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1274 microversion: 2.1 time: 0.362795 May 25 07:36:50.725323 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 23/40] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:36:50 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1274 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:36:50.757283 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-6ab83b89-4c80-4240-a1e9-fb6ad0844bf7 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:50.758563 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-6ab83b89-4c80-4240-a1e9-fb6ad0844bf7 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:36:50.770995 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6ab83b89-4c80-4240-a1e9-fb6ad0844bf7 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:50.771457 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6ab83b89-4c80-4240-a1e9-fb6ad0844bf7 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:50.772650 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6ab83b89-4c80-4240-a1e9-fb6ad0844bf7 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:50.774045 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6ab83b89-4c80-4240-a1e9-fb6ad0844bf7 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:50.924551 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=4 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:51.750436 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-dfdc4e2e-523d-48d5-8c9e-4c1cb567c296 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:51.750436 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-dfdc4e2e-523d-48d5-8c9e-4c1cb567c296 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:36:51.763502 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dfdc4e2e-523d-48d5-8c9e-4c1cb567c296 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:51.769367 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dfdc4e2e-523d-48d5-8c9e-4c1cb567c296 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:51.778167 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dfdc4e2e-523d-48d5-8c9e-4c1cb567c296 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:51.782327 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dfdc4e2e-523d-48d5-8c9e-4c1cb567c296 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:52.088578 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-dfdc4e2e-523d-48d5-8c9e-4c1cb567c296 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:36:52.110288 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-dfdc4e2e-523d-48d5-8c9e-4c1cb567c296 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1280 microversion: 2.1 time: 0.365772 May 25 07:36:52.118280 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 24/41] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:36:51 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1280 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:36:52.187419 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-6ab83b89-4c80-4240-a1e9-fb6ad0844bf7 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:36:52.197194 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-6ab83b89-4c80-4240-a1e9-fb6ad0844bf7 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1315 microversion: 2.1 time: 1.444099 May 25 07:36:52.200755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 18/42] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:36:50 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1315 bytes in 1448 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:36:53.135408 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-d404db4b-4f59-4d2b-a564-004f1efc453a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:53.136414 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-d404db4b-4f59-4d2b-a564-004f1efc453a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:36:53.148542 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d404db4b-4f59-4d2b-a564-004f1efc453a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:53.149007 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d404db4b-4f59-4d2b-a564-004f1efc453a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:53.149932 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d404db4b-4f59-4d2b-a564-004f1efc453a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:53.150313 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d404db4b-4f59-4d2b-a564-004f1efc453a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:53.216286 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d6006db3-d33b-48dc-a2c5-76918df8e687 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:53.217004 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d6006db3-d33b-48dc-a2c5-76918df8e687 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:36:53.238123 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d6006db3-d33b-48dc-a2c5-76918df8e687 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:53.244338 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d6006db3-d33b-48dc-a2c5-76918df8e687 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:53.245428 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d6006db3-d33b-48dc-a2c5-76918df8e687 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:53.251255 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d6006db3-d33b-48dc-a2c5-76918df8e687 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:53.707113 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d404db4b-4f59-4d2b-a564-004f1efc453a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:36:53.715960 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-d404db4b-4f59-4d2b-a564-004f1efc453a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1280 microversion: 2.1 time: 0.584531 May 25 07:36:53.716705 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 25/43] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:36:53 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1280 bytes in 586 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:36:54.735191 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b956a11f-f037-4b72-888e-e36a264544ed tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:54.735914 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b956a11f-f037-4b72-888e-e36a264544ed tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:36:54.748214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b956a11f-f037-4b72-888e-e36a264544ed tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:54.748718 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b956a11f-f037-4b72-888e-e36a264544ed tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:54.750265 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b956a11f-f037-4b72-888e-e36a264544ed tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:54.750933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b956a11f-f037-4b72-888e-e36a264544ed tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:54.803452 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d6006db3-d33b-48dc-a2c5-76918df8e687 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:36:54.827745 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d6006db3-d33b-48dc-a2c5-76918df8e687 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1315 microversion: 2.1 time: 1.615821 May 25 07:36:54.848809 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 19/44] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:36:53 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1315 bytes in 1638 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:36:55.299320 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b956a11f-f037-4b72-888e-e36a264544ed tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:36:55.311450 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b956a11f-f037-4b72-888e-e36a264544ed tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1322 microversion: 2.1 time: 0.579703 May 25 07:36:55.312921 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 26/45] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:36:54 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1322 bytes in 583 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:36:55.878860 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-29750a0e-f91f-43ed-ad98-c6bbd69918f8 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:55.879485 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-29750a0e-f91f-43ed-ad98-c6bbd69918f8 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:36:55.893429 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-29750a0e-f91f-43ed-ad98-c6bbd69918f8 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:55.894223 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-29750a0e-f91f-43ed-ad98-c6bbd69918f8 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:55.895275 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-29750a0e-f91f-43ed-ad98-c6bbd69918f8 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:55.895917 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-29750a0e-f91f-43ed-ad98-c6bbd69918f8 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:56.329847 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-99730251-c8ba-42c6-b863-cdb1ab217f2e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:36:56.330589 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-99730251-c8ba-42c6-b863-cdb1ab217f2e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:36:56.332808 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=2 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:56.345938 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-99730251-c8ba-42c6-b863-cdb1ab217f2e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:56.357376 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-99730251-c8ba-42c6-b863-cdb1ab217f2e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:56.361006 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-99730251-c8ba-42c6-b863-cdb1ab217f2e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:56.361672 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-99730251-c8ba-42c6-b863-cdb1ab217f2e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:56.536406 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=16 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:56.832836 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-99730251-c8ba-42c6-b863-cdb1ab217f2e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:36:56.845331 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-99730251-c8ba-42c6-b863-cdb1ab217f2e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1322 microversion: 2.1 time: 0.519547 May 25 07:36:56.856856 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 27/46] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:36:56 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1322 bytes in 532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:36:56.863808 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-c878d6e2-c8a6-4d34-81fa-e9a909357de0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-152865348", "imageRef": "ddc5b622-a846-425a-b8fd-7e5caef00bf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f85a9936-18a2-497c-90b9-ba6df25b9b6e"}], "security_groups": [{"name": "tempest-securitygroup--1433004589"}], "key_name": "tempest-keypair-1252439530", "user_data": "}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:36:56.872206 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=72,nova_api:INSERT=5 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:57.313845 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.network.neutron [None req-c878d6e2-c8a6-4d34-81fa-e9a909357de0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] validate_networks() for [('f85a9936-18a2-497c-90b9-ba6df25b9b6e', None, None, None, None, None)] {{(pid=124675) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:36:57.390952 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-29750a0e-f91f-43ed-ad98-c6bbd69918f8 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:36:57.404494 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-29750a0e-f91f-43ed-ad98-c6bbd69918f8 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1315 microversion: 2.1 time: 1.527705 May 25 07:36:57.405944 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 20/47] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:36:55 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1315 bytes in 1532 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:36:57.670234 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-0f1e1b14-9b6c-459d-9648-0a6d7bfcd8a2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-36671182", "imageRef": "ddc5b622-a846-425a-b8fd-7e5caef00bf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f39d85d3-0173-4496-879c-2b83e234d364"}], "security_groups": [{"name": "tempest-securitygroup--683392579"}], "key_name": "tempest-keypair-96530937", "user_data": "}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:36:58.005256 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=24 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:36:58.006068 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.network.neutron [None req-0f1e1b14-9b6c-459d-9648-0a6d7bfcd8a2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] validate_networks() for [('f39d85d3-0173-4496-879c-2b83e234d364', None, None, None, None, None)] {{(pid=124674) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:36:59.523766 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-c878d6e2-c8a6-4d34-81fa-e9a909357de0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Flavor limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:36:59.529278 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-c878d6e2-c8a6-4d34-81fa-e9a909357de0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Image limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:36:59.529278 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-c878d6e2-c8a6-4d34-81fa-e9a909357de0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Flavor pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:36:59.529278 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-c878d6e2-c8a6-4d34-81fa-e9a909357de0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Image pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:36:59.529278 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-c878d6e2-c8a6-4d34-81fa-e9a909357de0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:36:59.581682 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c878d6e2-c8a6-4d34-81fa-e9a909357de0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:59.583686 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c878d6e2-c8a6-4d34-81fa-e9a909357de0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:59.584851 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c878d6e2-c8a6-4d34-81fa-e9a909357de0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:36:59.585888 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c878d6e2-c8a6-4d34-81fa-e9a909357de0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:36:59.632099 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-c878d6e2-c8a6-4d34-81fa-e9a909357de0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Getting quotas for project 294afe2c36184564a80fb6bef7b32359. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:36:59.641090 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-c878d6e2-c8a6-4d34-81fa-e9a909357de0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Getting quotas for user 28d83ef95cda448dbd72acbd13a5f008 and project 294afe2c36184564a80fb6bef7b32359. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:36:59.675933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-c878d6e2-c8a6-4d34-81fa-e9a909357de0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Going to run 1 instances... {{(pid=124675) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:36:59.680394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-c878d6e2-c8a6-4d34-81fa-e9a909357de0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddc5b622-a846-425a-b8fd-7e5caef00bf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:36:59.993526 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-c878d6e2-c8a6-4d34-81fa-e9a909357de0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 3.133032 May 25 07:37:00.002992 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 28/48] 10.222.0.24 () {60 vars in 1146 bytes} [Wed May 25 07:36:56 2022] POST /compute/v2.1/servers => generated 402 bytes in 3145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 07:37:00.020758 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-678480ef-6e92-4947-a468-6832db445d58 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:00.021635 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-678480ef-6e92-4947-a468-6832db445d58 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:00.053038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-678480ef-6e92-4947-a468-6832db445d58 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:00.055376 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-678480ef-6e92-4947-a468-6832db445d58 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:00.059776 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-678480ef-6e92-4947-a468-6832db445d58 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:00.061237 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-678480ef-6e92-4947-a468-6832db445d58 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:00.392037 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-678480ef-6e92-4947-a468-6832db445d58 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:00.406072 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-678480ef-6e92-4947-a468-6832db445d58 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1322 microversion: 2.1 time: 0.400917 May 25 07:37:00.406852 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 29/49] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:00 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1322 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:00.444526 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-0f1e1b14-9b6c-459d-9648-0a6d7bfcd8a2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Flavor limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:37:00.445216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-0f1e1b14-9b6c-459d-9648-0a6d7bfcd8a2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Image limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:37:00.445491 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-0f1e1b14-9b6c-459d-9648-0a6d7bfcd8a2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Flavor pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:37:00.445914 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-0f1e1b14-9b6c-459d-9648-0a6d7bfcd8a2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Image pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:37:00.446479 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-0f1e1b14-9b6c-459d-9648-0a6d7bfcd8a2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:37:00.451686 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=56,nova_api:INSERT=7 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:00.480774 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0f1e1b14-9b6c-459d-9648-0a6d7bfcd8a2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:00.481178 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0f1e1b14-9b6c-459d-9648-0a6d7bfcd8a2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:00.489658 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0f1e1b14-9b6c-459d-9648-0a6d7bfcd8a2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:00.490375 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0f1e1b14-9b6c-459d-9648-0a6d7bfcd8a2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:00.533193 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=47 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:00.556821 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-0f1e1b14-9b6c-459d-9648-0a6d7bfcd8a2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Getting quotas for project 2d8e35800ce043acbcb027ce406ed2e7. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:37:00.562502 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-0f1e1b14-9b6c-459d-9648-0a6d7bfcd8a2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Getting quotas for user 0487ea9076ee4baf8138fdc25ce02522 and project 2d8e35800ce043acbcb027ce406ed2e7. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:37:00.615130 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-0f1e1b14-9b6c-459d-9648-0a6d7bfcd8a2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Going to run 1 instances... {{(pid=124674) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:37:00.621867 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-0f1e1b14-9b6c-459d-9648-0a6d7bfcd8a2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddc5b622-a846-425a-b8fd-7e5caef00bf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:37:00.939575 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-db5e7cb7-072b-45e0-a3e2-0055877de742 req-3abcf226-ccc6-4232-b7ed-e3b969eb0cff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "57fedc8c-b769-4f1d-b263-478dcb44da40", "tag": "25dfc8d5-59b2-4523-b077-3638d5408b3d"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:37:01.009503 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-db5e7cb7-072b-45e0-a3e2-0055877de742 req-3abcf226-ccc6-4232-b7ed-e3b969eb0cff service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:01.010344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-db5e7cb7-072b-45e0-a3e2-0055877de742 req-3abcf226-ccc6-4232-b7ed-e3b969eb0cff service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:01.047234 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-db5e7cb7-072b-45e0-a3e2-0055877de742 req-3abcf226-ccc6-4232-b7ed-e3b969eb0cff service nova] Creating event network-changed:25dfc8d5-59b2-4523-b077-3638d5408b3d for instance 57fedc8c-b769-4f1d-b263-478dcb44da40 on hv-cinder-82549 May 25 07:37:01.048055 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-db5e7cb7-072b-45e0-a3e2-0055877de742 req-3abcf226-ccc6-4232-b7ed-e3b969eb0cff service nova] Acquired lock "compute-rpcapi-router" {{(pid=124675) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 25 07:37:01.049421 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-20451b63-b140-4d2d-b4e2-01cf96a2ce4c None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:01.050150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-20451b63-b140-4d2d-b4e2-01cf96a2ce4c None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:01.051122 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-20451b63-b140-4d2d-b4e2-01cf96a2ce4c None None] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:01.051726 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-20451b63-b140-4d2d-b4e2-01cf96a2ce4c None None] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:01.063280 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.compute.rpcapi [None req-20451b63-b140-4d2d-b4e2-01cf96a2ce4c None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 25 07:37:01.064087 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-20451b63-b140-4d2d-b4e2-01cf96a2ce4c None None] Releasing lock "compute-rpcapi-router" {{(pid=124675) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 25 07:37:01.123023 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-20451b63-b140-4d2d-b4e2-01cf96a2ce4c None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.708802 May 25 07:37:01.123643 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 30/50] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:37:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 710 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:37:01.129503 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-810ada72-8aa0-45fb-abdc-3802f8a1fca5 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:01.130461 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-810ada72-8aa0-45fb-abdc-3802f8a1fca5 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:01.155183 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-810ada72-8aa0-45fb-abdc-3802f8a1fca5 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:01.155183 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-810ada72-8aa0-45fb-abdc-3802f8a1fca5 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:01.155183 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-810ada72-8aa0-45fb-abdc-3802f8a1fca5 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:01.155183 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-810ada72-8aa0-45fb-abdc-3802f8a1fca5 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:01.271606 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-0f1e1b14-9b6c-459d-9648-0a6d7bfcd8a2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 3.639949 May 25 07:37:01.272843 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 21/51] 10.222.0.24 () {60 vars in 1146 bytes} [Wed May 25 07:36:57 2022] POST /compute/v2.1/servers => generated 401 bytes in 3642 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 07:37:01.281881 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-e8fdc9b5-9394-43b6-87ba-6b18befa8086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-191129153", "imageRef": "ddc5b622-a846-425a-b8fd-7e5caef00bf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7eef0ae9-55de-48c4-ada3-da713e1942b9"}], "security_groups": [{"name": "tempest-securitygroup--44538836"}], "key_name": "tempest-keypair-1139576538", "user_data": "}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:37:01.524201 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.network.neutron [None req-e8fdc9b5-9394-43b6-87ba-6b18befa8086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] validate_networks() for [('7eef0ae9-55de-48c4-ada3-da713e1942b9', None, None, None, None, None)] {{(pid=124674) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:37:01.857295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-810ada72-8aa0-45fb-abdc-3802f8a1fca5 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:01.869022 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-810ada72-8aa0-45fb-abdc-3802f8a1fca5 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1315 microversion: 2.1 time: 0.744061 May 25 07:37:01.870239 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 31/52] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:01 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1315 bytes in 746 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:02.087501 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-69817771-127f-49f9-9bc8-04aa2d824693 req-92d45221-6684-4c54-b350-56e50b829fe1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f652bc42-42f2-4664-b614-603b3ddf84b1", "tag": "5d521607-ce1e-41b4-a067-fdc197d09700"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:37:02.105892 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-69817771-127f-49f9-9bc8-04aa2d824693 req-92d45221-6684-4c54-b350-56e50b829fe1 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:02.109646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-69817771-127f-49f9-9bc8-04aa2d824693 req-92d45221-6684-4c54-b350-56e50b829fe1 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:02.136465 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-69817771-127f-49f9-9bc8-04aa2d824693 req-92d45221-6684-4c54-b350-56e50b829fe1 service nova] Creating event network-changed:5d521607-ce1e-41b4-a067-fdc197d09700 for instance f652bc42-42f2-4664-b614-603b3ddf84b1 on hv-cinder-82549 May 25 07:37:02.146313 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-69817771-127f-49f9-9bc8-04aa2d824693 req-92d45221-6684-4c54-b350-56e50b829fe1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.272666 May 25 07:37:02.148462 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 32/53] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:37:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:37:02.162998 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4ba95d41-7481-4ccb-89cf-09e68a93f328 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:02.163643 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4ba95d41-7481-4ccb-89cf-09e68a93f328 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:02.234513 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4ba95d41-7481-4ccb-89cf-09e68a93f328 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:02.244993 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4ba95d41-7481-4ccb-89cf-09e68a93f328 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1237 microversion: 2.1 time: 0.088004 May 25 07:37:02.246190 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 33/54] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:02 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1237 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:02.252679 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-f20e91e1-e86f-4e13-8582-b6353dd8a926 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:02.253591 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-f20e91e1-e86f-4e13-8582-b6353dd8a926 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:02.336728 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-f20e91e1-e86f-4e13-8582-b6353dd8a926 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:02.360351 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-f20e91e1-e86f-4e13-8582-b6353dd8a926 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1238 microversion: 2.1 time: 0.111321 May 25 07:37:02.364551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 34/55] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:02 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1238 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:02.376709 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-71aef190-6ca0-4313-81ec-dc8939952440 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:02.380037 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-71aef190-6ca0-4313-81ec-dc8939952440 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:02.389851 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-71aef190-6ca0-4313-81ec-dc8939952440 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:02.390544 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-71aef190-6ca0-4313-81ec-dc8939952440 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:02.391688 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-71aef190-6ca0-4313-81ec-dc8939952440 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:02.392323 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-71aef190-6ca0-4313-81ec-dc8939952440 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:02.416586 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-e8fdc9b5-9394-43b6-87ba-6b18befa8086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Flavor limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:37:02.417229 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-e8fdc9b5-9394-43b6-87ba-6b18befa8086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Image limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:37:02.417854 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-e8fdc9b5-9394-43b6-87ba-6b18befa8086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Flavor pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:37:02.418512 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-e8fdc9b5-9394-43b6-87ba-6b18befa8086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Image pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:37:02.419092 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-e8fdc9b5-9394-43b6-87ba-6b18befa8086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:37:02.434169 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e8fdc9b5-9394-43b6-87ba-6b18befa8086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:02.438914 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e8fdc9b5-9394-43b6-87ba-6b18befa8086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:02.438914 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e8fdc9b5-9394-43b6-87ba-6b18befa8086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:02.438914 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e8fdc9b5-9394-43b6-87ba-6b18befa8086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:02.463796 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-e8fdc9b5-9394-43b6-87ba-6b18befa8086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Getting quotas for project c4406d5d0e2347f1b96c34496f5ba5ae. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:37:02.468395 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-e8fdc9b5-9394-43b6-87ba-6b18befa8086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Getting quotas for user 18eb8b615526451498d3adc382d5a410 and project c4406d5d0e2347f1b96c34496f5ba5ae. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:37:02.481824 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-e8fdc9b5-9394-43b6-87ba-6b18befa8086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Going to run 1 instances... {{(pid=124674) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:37:02.482595 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-e8fdc9b5-9394-43b6-87ba-6b18befa8086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddc5b622-a846-425a-b8fd-7e5caef00bf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:37:02.584405 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-71aef190-6ca0-4313-81ec-dc8939952440 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:02.596614 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-71aef190-6ca0-4313-81ec-dc8939952440 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1322 microversion: 2.1 time: 0.230689 May 25 07:37:02.597246 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 35/56] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:02 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1322 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:02.608099 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-e8fdc9b5-9394-43b6-87ba-6b18befa8086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.20 time: 1.333757 May 25 07:37:02.609290 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 22/57] 10.222.0.24 () {62 vars in 1187 bytes} [Wed May 25 07:37:01 2022] POST /compute/v2.1/servers => generated 400 bytes in 1336 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 25 07:37:02.620497 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ce811dc6-a4a0-4996-a10a-ae8e3d325288 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:02.621136 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ce811dc6-a4a0-4996-a10a-ae8e3d325288 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:02.679763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ce811dc6-a4a0-4996-a10a-ae8e3d325288 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:02.699681 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ce811dc6-a4a0-4996-a10a-ae8e3d325288 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:02.699681 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ce811dc6-a4a0-4996-a10a-ae8e3d325288 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:02.699681 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ce811dc6-a4a0-4996-a10a-ae8e3d325288 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1281 microversion: 2.20 time: 0.080512 May 25 07:37:02.699965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 36/58] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:37:02 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1281 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:37:02.887228 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-2215455f-44b3-4a8d-a34e-75a4c554f5ea tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:02.888673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-2215455f-44b3-4a8d-a34e-75a4c554f5ea tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:02.901766 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2215455f-44b3-4a8d-a34e-75a4c554f5ea tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:02.902220 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2215455f-44b3-4a8d-a34e-75a4c554f5ea tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:02.903030 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2215455f-44b3-4a8d-a34e-75a4c554f5ea tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:02.903468 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2215455f-44b3-4a8d-a34e-75a4c554f5ea tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:03.071376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-2215455f-44b3-4a8d-a34e-75a4c554f5ea tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:03.079181 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-2215455f-44b3-4a8d-a34e-75a4c554f5ea tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1315 microversion: 2.1 time: 0.195714 May 25 07:37:03.079700 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 23/59] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:02 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1315 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:03.148404 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-2c7aed0c-51f8-4a0e-a134-9472bc89454c req-1c693833-9b69-43d5-9434-2bc8d7b2c7bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2d5a90d7-311f-4e4a-84c2-ff14c0440bd2", "tag": "37369604-0009-4591-97a8-6e3c90d97049"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:37:03.158984 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-2c7aed0c-51f8-4a0e-a134-9472bc89454c req-1c693833-9b69-43d5-9434-2bc8d7b2c7bc service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:03.159662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-2c7aed0c-51f8-4a0e-a134-9472bc89454c req-1c693833-9b69-43d5-9434-2bc8d7b2c7bc service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:03.176423 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-2c7aed0c-51f8-4a0e-a134-9472bc89454c req-1c693833-9b69-43d5-9434-2bc8d7b2c7bc service nova] Creating event network-changed:37369604-0009-4591-97a8-6e3c90d97049 for instance 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 on hv-cinder-82549 May 25 07:37:03.183418 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-2c7aed0c-51f8-4a0e-a134-9472bc89454c req-1c693833-9b69-43d5-9434-2bc8d7b2c7bc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037761 May 25 07:37:03.183418 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 37/60] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:37:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:37:03.262295 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-bd4c9497-15a8-4734-a1fe-86e7f9fc2deb tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:03.262908 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-bd4c9497-15a8-4734-a1fe-86e7f9fc2deb tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:03.268997 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bd4c9497-15a8-4734-a1fe-86e7f9fc2deb tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:03.272499 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bd4c9497-15a8-4734-a1fe-86e7f9fc2deb tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:03.272499 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bd4c9497-15a8-4734-a1fe-86e7f9fc2deb tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:03.272499 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bd4c9497-15a8-4734-a1fe-86e7f9fc2deb tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:03.360540 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-bd4c9497-15a8-4734-a1fe-86e7f9fc2deb tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:03.368871 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-bd4c9497-15a8-4734-a1fe-86e7f9fc2deb tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1241 microversion: 2.1 time: 0.110479 May 25 07:37:03.369535 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 24/61] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:03 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1241 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:03.377865 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-15992e1c-4692-4fd5-bd21-827995042ff4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:03.378567 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-15992e1c-4692-4fd5-bd21-827995042ff4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:03.385254 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-15992e1c-4692-4fd5-bd21-827995042ff4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:03.385707 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-15992e1c-4692-4fd5-bd21-827995042ff4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:03.386667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-15992e1c-4692-4fd5-bd21-827995042ff4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:03.387109 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-15992e1c-4692-4fd5-bd21-827995042ff4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:03.455656 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-15992e1c-4692-4fd5-bd21-827995042ff4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:03.463524 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-15992e1c-4692-4fd5-bd21-827995042ff4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1242 microversion: 2.1 time: 0.090329 May 25 07:37:03.464175 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 38/62] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:03 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1242 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:03.614337 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-954fab19-b762-451a-9d55-9ec57f2243c8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:03.615091 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-954fab19-b762-451a-9d55-9ec57f2243c8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:03.622633 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-954fab19-b762-451a-9d55-9ec57f2243c8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:03.623221 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-954fab19-b762-451a-9d55-9ec57f2243c8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:03.624175 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-954fab19-b762-451a-9d55-9ec57f2243c8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:03.625040 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-954fab19-b762-451a-9d55-9ec57f2243c8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:03.714918 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-683de170-4930-4347-9d18-5e57719af37b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:03.715603 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-683de170-4930-4347-9d18-5e57719af37b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:03.770235 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-954fab19-b762-451a-9d55-9ec57f2243c8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:03.776394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-683de170-4930-4347-9d18-5e57719af37b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:03.798677 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-683de170-4930-4347-9d18-5e57719af37b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:03.798677 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-683de170-4930-4347-9d18-5e57719af37b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:03.798677 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-683de170-4930-4347-9d18-5e57719af37b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1281 microversion: 2.20 time: 0.077339 May 25 07:37:03.799071 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 39/63] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:37:03 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1281 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:37:03.810539 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-954fab19-b762-451a-9d55-9ec57f2243c8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1322 microversion: 2.1 time: 0.200057 May 25 07:37:03.811127 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 25/64] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:03 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1322 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:04.096080 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-9a83ca39-819b-4440-bb84-0d5d04fc49c4 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:04.096753 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-9a83ca39-819b-4440-bb84-0d5d04fc49c4 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:04.103957 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9a83ca39-819b-4440-bb84-0d5d04fc49c4 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:04.104411 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9a83ca39-819b-4440-bb84-0d5d04fc49c4 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:04.105579 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9a83ca39-819b-4440-bb84-0d5d04fc49c4 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:04.106167 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9a83ca39-819b-4440-bb84-0d5d04fc49c4 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:04.244998 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-9a83ca39-819b-4440-bb84-0d5d04fc49c4 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:04.254065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-9a83ca39-819b-4440-bb84-0d5d04fc49c4 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1315 microversion: 2.1 time: 0.161781 May 25 07:37:04.254650 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 40/65] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:04 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:04.396055 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d8f80ebe-c343-4d7a-993b-fd1a467aac7e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:04.396756 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d8f80ebe-c343-4d7a-993b-fd1a467aac7e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:04.403191 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d8f80ebe-c343-4d7a-993b-fd1a467aac7e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:04.403610 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d8f80ebe-c343-4d7a-993b-fd1a467aac7e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:04.406792 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d8f80ebe-c343-4d7a-993b-fd1a467aac7e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:04.407257 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d8f80ebe-c343-4d7a-993b-fd1a467aac7e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:04.472119 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d8f80ebe-c343-4d7a-993b-fd1a467aac7e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:04.482648 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d8f80ebe-c343-4d7a-993b-fd1a467aac7e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1241 microversion: 2.1 time: 0.091516 May 25 07:37:04.483395 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 26/66] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:04 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1241 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:04.484310 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-fee3bb44-d957-4690-a250-3cdc1c48187b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:04.485603 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-fee3bb44-d957-4690-a250-3cdc1c48187b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:04.492022 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fee3bb44-d957-4690-a250-3cdc1c48187b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:04.492663 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fee3bb44-d957-4690-a250-3cdc1c48187b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:04.495061 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fee3bb44-d957-4690-a250-3cdc1c48187b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:04.495061 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fee3bb44-d957-4690-a250-3cdc1c48187b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:04.595946 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-fee3bb44-d957-4690-a250-3cdc1c48187b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:04.608447 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-fee3bb44-d957-4690-a250-3cdc1c48187b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1242 microversion: 2.1 time: 0.128645 May 25 07:37:04.616627 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 41/67] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:04 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1242 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:04.806018 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-8de9c868-3c09-4e41-8f43-11e8c967177a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:04.807319 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-8de9c868-3c09-4e41-8f43-11e8c967177a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:04.815079 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8de9c868-3c09-4e41-8f43-11e8c967177a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:04.816062 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8de9c868-3c09-4e41-8f43-11e8c967177a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:04.817244 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8de9c868-3c09-4e41-8f43-11e8c967177a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:04.817692 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8de9c868-3c09-4e41-8f43-11e8c967177a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:04.828837 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4f4f465f-17b1-4fe7-888b-88adaba43cec tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:04.829706 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4f4f465f-17b1-4fe7-888b-88adaba43cec tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:04.837454 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4f4f465f-17b1-4fe7-888b-88adaba43cec tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:04.837454 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4f4f465f-17b1-4fe7-888b-88adaba43cec tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:04.838187 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4f4f465f-17b1-4fe7-888b-88adaba43cec tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:04.838794 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4f4f465f-17b1-4fe7-888b-88adaba43cec tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:04.878666 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=100 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:04.934846 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-8de9c868-3c09-4e41-8f43-11e8c967177a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:04.963676 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-8de9c868-3c09-4e41-8f43-11e8c967177a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:04.973641 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-8de9c868-3c09-4e41-8f43-11e8c967177a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:04.977395 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-8de9c868-3c09-4e41-8f43-11e8c967177a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1285 microversion: 2.20 time: 0.175583 May 25 07:37:04.982282 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 27/68] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:37:04 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1285 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:37:05.128086 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4f4f465f-17b1-4fe7-888b-88adaba43cec tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:05.136559 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4f4f465f-17b1-4fe7-888b-88adaba43cec tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1322 microversion: 2.1 time: 0.312077 May 25 07:37:05.137340 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 42/69] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:04 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1322 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:37:05.270951 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d15f9abe-8206-4d12-be7e-2bc6887f6639 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:05.271584 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d15f9abe-8206-4d12-be7e-2bc6887f6639 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:05.288297 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d15f9abe-8206-4d12-be7e-2bc6887f6639 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:05.290927 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d15f9abe-8206-4d12-be7e-2bc6887f6639 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:05.293519 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d15f9abe-8206-4d12-be7e-2bc6887f6639 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:05.293978 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d15f9abe-8206-4d12-be7e-2bc6887f6639 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:05.496800 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d15f9abe-8206-4d12-be7e-2bc6887f6639 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:05.500022 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-55434940-c991-4887-a694-93a541e67552 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:05.500805 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-55434940-c991-4887-a694-93a541e67552 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:05.505140 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d15f9abe-8206-4d12-be7e-2bc6887f6639 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1315 microversion: 2.1 time: 0.238040 May 25 07:37:05.509616 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 28/70] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:05 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1315 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:05.511566 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-55434940-c991-4887-a694-93a541e67552 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:05.512127 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-55434940-c991-4887-a694-93a541e67552 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:05.512823 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-55434940-c991-4887-a694-93a541e67552 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:05.513267 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-55434940-c991-4887-a694-93a541e67552 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:05.575909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-55434940-c991-4887-a694-93a541e67552 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:05.585173 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-55434940-c991-4887-a694-93a541e67552 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1289 microversion: 2.1 time: 0.088465 May 25 07:37:05.585173 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 43/71] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:05 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1289 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:37:05.627887 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-70bbb412-c06f-453f-8a40-d150e53c4500 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:05.628557 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-70bbb412-c06f-453f-8a40-d150e53c4500 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:05.634860 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-70bbb412-c06f-453f-8a40-d150e53c4500 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:05.635303 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-70bbb412-c06f-453f-8a40-d150e53c4500 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:05.636061 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-70bbb412-c06f-453f-8a40-d150e53c4500 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:05.636559 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-70bbb412-c06f-453f-8a40-d150e53c4500 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:05.699898 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-70bbb412-c06f-453f-8a40-d150e53c4500 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:05.707873 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-70bbb412-c06f-453f-8a40-d150e53c4500 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1290 microversion: 2.1 time: 0.084695 May 25 07:37:05.708896 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 29/72] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:05 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1290 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:05.997804 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-bacabcbd-7948-4ec8-adc4-13a55d546c0f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:05.998459 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-bacabcbd-7948-4ec8-adc4-13a55d546c0f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:06.005408 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-bacabcbd-7948-4ec8-adc4-13a55d546c0f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:06.006086 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-bacabcbd-7948-4ec8-adc4-13a55d546c0f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:06.007619 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-bacabcbd-7948-4ec8-adc4-13a55d546c0f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:06.008069 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-bacabcbd-7948-4ec8-adc4-13a55d546c0f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:06.072712 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-bacabcbd-7948-4ec8-adc4-13a55d546c0f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:06.080644 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-bacabcbd-7948-4ec8-adc4-13a55d546c0f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:06.082166 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-bacabcbd-7948-4ec8-adc4-13a55d546c0f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:06.083264 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-bacabcbd-7948-4ec8-adc4-13a55d546c0f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1333 microversion: 2.20 time: 0.089504 May 25 07:37:06.083826 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 44/73] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:37:05 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1333 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:37:06.155236 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-2cf9481c-6a01-47a2-812b-490b0ff6ea40 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:06.157075 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-2cf9481c-6a01-47a2-812b-490b0ff6ea40 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:06.163431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2cf9481c-6a01-47a2-812b-490b0ff6ea40 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:06.163883 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2cf9481c-6a01-47a2-812b-490b0ff6ea40 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:06.164698 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2cf9481c-6a01-47a2-812b-490b0ff6ea40 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:06.165138 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2cf9481c-6a01-47a2-812b-490b0ff6ea40 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:06.301028 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-2cf9481c-6a01-47a2-812b-490b0ff6ea40 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:06.312832 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-2cf9481c-6a01-47a2-812b-490b0ff6ea40 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1322 microversion: 2.1 time: 0.161320 May 25 07:37:06.314061 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 30/74] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:06 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:06.523187 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-cb0f987a-d399-4c7f-8d63-0f556eaf642e tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:06.524464 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-cb0f987a-d399-4c7f-8d63-0f556eaf642e tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:06.531694 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cb0f987a-d399-4c7f-8d63-0f556eaf642e tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:06.532217 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cb0f987a-d399-4c7f-8d63-0f556eaf642e tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:06.533072 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cb0f987a-d399-4c7f-8d63-0f556eaf642e tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:06.533512 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cb0f987a-d399-4c7f-8d63-0f556eaf642e tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:06.620046 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7a03f843-811e-4edc-ae42-307ccbec7bc7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:06.620963 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-7a03f843-811e-4edc-ae42-307ccbec7bc7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:06.640273 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7a03f843-811e-4edc-ae42-307ccbec7bc7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:06.641282 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7a03f843-811e-4edc-ae42-307ccbec7bc7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:06.642542 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7a03f843-811e-4edc-ae42-307ccbec7bc7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:06.643274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7a03f843-811e-4edc-ae42-307ccbec7bc7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:06.669600 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-cb0f987a-d399-4c7f-8d63-0f556eaf642e tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:06.677195 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-cb0f987a-d399-4c7f-8d63-0f556eaf642e tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1315 microversion: 2.1 time: 0.158330 May 25 07:37:06.680968 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 45/75] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:06 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1315 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:06.723600 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7a03f843-811e-4edc-ae42-307ccbec7bc7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:06.725193 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-dd0278e5-0d07-4202-9d22-9f59610496c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:06.725802 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-dd0278e5-0d07-4202-9d22-9f59610496c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:06.732294 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dd0278e5-0d07-4202-9d22-9f59610496c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:06.732747 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dd0278e5-0d07-4202-9d22-9f59610496c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:06.732857 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-7a03f843-811e-4edc-ae42-307ccbec7bc7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1289 microversion: 2.1 time: 0.129028 May 25 07:37:06.733535 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 31/76] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:06 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1289 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:06.733653 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dd0278e5-0d07-4202-9d22-9f59610496c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:06.734126 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dd0278e5-0d07-4202-9d22-9f59610496c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:06.795452 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-dd0278e5-0d07-4202-9d22-9f59610496c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:06.802821 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-dd0278e5-0d07-4202-9d22-9f59610496c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1290 microversion: 2.1 time: 0.081583 May 25 07:37:06.803533 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 46/77] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:06 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1290 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:37:07.104265 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-816de2ae-b43a-4296-8c00-958f4455b18a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:07.106190 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-816de2ae-b43a-4296-8c00-958f4455b18a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:07.114173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-816de2ae-b43a-4296-8c00-958f4455b18a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:07.114831 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-816de2ae-b43a-4296-8c00-958f4455b18a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:07.115823 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-816de2ae-b43a-4296-8c00-958f4455b18a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:07.116843 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-816de2ae-b43a-4296-8c00-958f4455b18a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:07.292239 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-816de2ae-b43a-4296-8c00-958f4455b18a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:07.302338 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-816de2ae-b43a-4296-8c00-958f4455b18a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:07.309770 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-816de2ae-b43a-4296-8c00-958f4455b18a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:07.309770 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-816de2ae-b43a-4296-8c00-958f4455b18a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1333 microversion: 2.20 time: 0.207018 May 25 07:37:07.309770 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 32/78] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:37:07 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1333 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:37:07.331816 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-dfa8e7d7-1393-408d-9964-048a10db5ca4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:07.332458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-dfa8e7d7-1393-408d-9964-048a10db5ca4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:07.340234 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dfa8e7d7-1393-408d-9964-048a10db5ca4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:07.341032 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dfa8e7d7-1393-408d-9964-048a10db5ca4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:07.342080 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dfa8e7d7-1393-408d-9964-048a10db5ca4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:07.344280 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dfa8e7d7-1393-408d-9964-048a10db5ca4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:07.637108 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-21458162-4413-42f9-867c-6fa2a0c20b77 req-f3d3fab9-d483-4139-9ace-7454d936e02c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57fedc8c-b769-4f1d-b263-478dcb44da40", "name": "network-vif-plugged", "status": "completed", "tag": "25dfc8d5-59b2-4523-b077-3638d5408b3d"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:37:07.654320 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-21458162-4413-42f9-867c-6fa2a0c20b77 req-f3d3fab9-d483-4139-9ace-7454d936e02c service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:07.655151 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-21458162-4413-42f9-867c-6fa2a0c20b77 req-f3d3fab9-d483-4139-9ace-7454d936e02c service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:07.680395 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-21458162-4413-42f9-867c-6fa2a0c20b77 req-f3d3fab9-d483-4139-9ace-7454d936e02c service nova] Creating event network-vif-plugged:25dfc8d5-59b2-4523-b077-3638d5408b3d for instance 57fedc8c-b769-4f1d-b263-478dcb44da40 on hv-cinder-82549 May 25 07:37:07.684118 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-21458162-4413-42f9-867c-6fa2a0c20b77 req-f3d3fab9-d483-4139-9ace-7454d936e02c service nova] Acquired lock "compute-rpcapi-router" {{(pid=124674) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} May 25 07:37:07.687744 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-504ac91c-416c-4f35-8b28-81024291d038 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:07.687744 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-504ac91c-416c-4f35-8b28-81024291d038 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:07.687744 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-504ac91c-416c-4f35-8b28-81024291d038 None None] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:07.687744 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-504ac91c-416c-4f35-8b28-81024291d038 None None] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:07.700460 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.compute.rpcapi [None req-504ac91c-416c-4f35-8b28-81024291d038 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 May 25 07:37:07.702227 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-504ac91c-416c-4f35-8b28-81024291d038 None None] Releasing lock "compute-rpcapi-router" {{(pid=124674) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} May 25 07:37:07.727994 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-dfa8e7d7-1393-408d-9964-048a10db5ca4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:07.745122 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-504ac91c-416c-4f35-8b28-81024291d038 None None] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.217398 May 25 07:37:07.745122 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 33/79] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:37:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:37:07.749692 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-dfa8e7d7-1393-408d-9964-048a10db5ca4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1322 microversion: 2.1 time: 0.423082 May 25 07:37:07.750956 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 47/80] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:07 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1322 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:07.754172 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-cc8e0f1c-bc70-4450-b657-d2d662b6dce0 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:07.754872 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-cc8e0f1c-bc70-4450-b657-d2d662b6dce0 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:07.756338 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-326d25c5-f92d-4846-8139-32a7b5693e30 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:07.757387 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-326d25c5-f92d-4846-8139-32a7b5693e30 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:07.763625 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-326d25c5-f92d-4846-8139-32a7b5693e30 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:07.764363 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-326d25c5-f92d-4846-8139-32a7b5693e30 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:07.765700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-326d25c5-f92d-4846-8139-32a7b5693e30 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:07.766442 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-326d25c5-f92d-4846-8139-32a7b5693e30 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:07.768300 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cc8e0f1c-bc70-4450-b657-d2d662b6dce0 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:07.768775 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cc8e0f1c-bc70-4450-b657-d2d662b6dce0 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:07.769571 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cc8e0f1c-bc70-4450-b657-d2d662b6dce0 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:07.769979 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cc8e0f1c-bc70-4450-b657-d2d662b6dce0 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:07.885144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-326d25c5-f92d-4846-8139-32a7b5693e30 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:07.924158 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-326d25c5-f92d-4846-8139-32a7b5693e30 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1307 microversion: 2.1 time: 0.171792 May 25 07:37:07.924816 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 48/81] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:07 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1307 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:07.930491 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-167a9600-fc25-4738-b954-e6706f4b85b0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:07.931804 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-167a9600-fc25-4738-b954-e6706f4b85b0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:07.938953 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-167a9600-fc25-4738-b954-e6706f4b85b0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:07.939607 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-167a9600-fc25-4738-b954-e6706f4b85b0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:07.953327 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-167a9600-fc25-4738-b954-e6706f4b85b0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:07.954859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-167a9600-fc25-4738-b954-e6706f4b85b0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:08.035898 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-cc8e0f1c-bc70-4450-b657-d2d662b6dce0 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:08.051335 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-cc8e0f1c-bc70-4450-b657-d2d662b6dce0 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1315 microversion: 2.1 time: 0.304658 May 25 07:37:08.053316 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 34/82] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:07 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1315 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:08.053579 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-167a9600-fc25-4738-b954-e6706f4b85b0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:08.068301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-167a9600-fc25-4738-b954-e6706f4b85b0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1308 microversion: 2.1 time: 0.141857 May 25 07:37:08.068918 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 49/83] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:07 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1308 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:08.325296 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c66e54f4-f3cb-4a61-9486-955b613f6f87 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:08.325954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c66e54f4-f3cb-4a61-9486-955b613f6f87 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:08.335130 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c66e54f4-f3cb-4a61-9486-955b613f6f87 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:08.335615 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c66e54f4-f3cb-4a61-9486-955b613f6f87 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:08.336401 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c66e54f4-f3cb-4a61-9486-955b613f6f87 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:08.336861 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c66e54f4-f3cb-4a61-9486-955b613f6f87 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:08.501594 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c66e54f4-f3cb-4a61-9486-955b613f6f87 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:08.515247 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c66e54f4-f3cb-4a61-9486-955b613f6f87 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:08.516519 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c66e54f4-f3cb-4a61-9486-955b613f6f87 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:08.517804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c66e54f4-f3cb-4a61-9486-955b613f6f87 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1339 microversion: 2.20 time: 0.198243 May 25 07:37:08.518719 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 35/84] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:37:08 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1339 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:37:08.770124 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-e6131743-1462-4c3f-8c73-0296f5919b2a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:08.770124 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-e6131743-1462-4c3f-8c73-0296f5919b2a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:08.775857 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e6131743-1462-4c3f-8c73-0296f5919b2a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:08.776650 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e6131743-1462-4c3f-8c73-0296f5919b2a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:08.777435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e6131743-1462-4c3f-8c73-0296f5919b2a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:08.777943 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e6131743-1462-4c3f-8c73-0296f5919b2a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:08.943327 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-f059758e-15a5-493a-8a0c-b288988455cf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:08.945831 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-f059758e-15a5-493a-8a0c-b288988455cf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:09.002011 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f059758e-15a5-493a-8a0c-b288988455cf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:09.003704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f059758e-15a5-493a-8a0c-b288988455cf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:09.004862 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f059758e-15a5-493a-8a0c-b288988455cf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:09.005308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f059758e-15a5-493a-8a0c-b288988455cf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:09.130427 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-e6131743-1462-4c3f-8c73-0296f5919b2a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:09.141818 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-e6131743-1462-4c3f-8c73-0296f5919b2a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1322 microversion: 2.1 time: 0.378881 May 25 07:37:09.151673 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 50/85] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:08 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1322 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:09.166078 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-e1deb777-bc26-4efc-a831-86ac07da3582 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:09.166078 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-e1deb777-bc26-4efc-a831-86ac07da3582 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:09.168181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e1deb777-bc26-4efc-a831-86ac07da3582 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:09.169233 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e1deb777-bc26-4efc-a831-86ac07da3582 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:09.170418 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e1deb777-bc26-4efc-a831-86ac07da3582 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:09.171097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e1deb777-bc26-4efc-a831-86ac07da3582 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:09.474988 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-f059758e-15a5-493a-8a0c-b288988455cf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:09.486023 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-f059758e-15a5-493a-8a0c-b288988455cf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1363 microversion: 2.1 time: 0.547935 May 25 07:37:09.487323 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 36/86] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:08 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1363 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:09.493371 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-b6964b01-d8f1-40d7-a868-f6a5053c4a9c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:09.494340 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-b6964b01-d8f1-40d7-a868-f6a5053c4a9c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:09.501777 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b6964b01-d8f1-40d7-a868-f6a5053c4a9c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:09.502566 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b6964b01-d8f1-40d7-a868-f6a5053c4a9c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:09.503570 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b6964b01-d8f1-40d7-a868-f6a5053c4a9c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:09.504227 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b6964b01-d8f1-40d7-a868-f6a5053c4a9c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:09.725911 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-e1deb777-bc26-4efc-a831-86ac07da3582 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:09.734671 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-e1deb777-bc26-4efc-a831-86ac07da3582 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1315 microversion: 2.1 time: 0.581391 May 25 07:37:09.736978 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 51/87] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:09 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1315 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:09.745974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-49eb1dc6-1d1a-4cd7-9580-8eb1568f6c6a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:09.746649 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-49eb1dc6-1d1a-4cd7-9580-8eb1568f6c6a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:09.755267 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-49eb1dc6-1d1a-4cd7-9580-8eb1568f6c6a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:09.755726 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-49eb1dc6-1d1a-4cd7-9580-8eb1568f6c6a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:09.757061 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-49eb1dc6-1d1a-4cd7-9580-8eb1568f6c6a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:09.757835 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-49eb1dc6-1d1a-4cd7-9580-8eb1568f6c6a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:09.803047 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-b6964b01-d8f1-40d7-a868-f6a5053c4a9c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:09.810935 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-b6964b01-d8f1-40d7-a868-f6a5053c4a9c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1363 microversion: 2.1 time: 0.322310 May 25 07:37:09.811508 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 37/88] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:09 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1363 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:09.932691 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-49eb1dc6-1d1a-4cd7-9580-8eb1568f6c6a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:09.941582 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-49eb1dc6-1d1a-4cd7-9580-8eb1568f6c6a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:09.943215 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-49eb1dc6-1d1a-4cd7-9580-8eb1568f6c6a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:09.944335 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-49eb1dc6-1d1a-4cd7-9580-8eb1568f6c6a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1405 microversion: 2.20 time: 0.206107 May 25 07:37:09.944948 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 52/89] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:37:09 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1405 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:37:10.160054 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-6422378e-bf1a-4728-9907-d88a43d325ab tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:10.160959 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-6422378e-bf1a-4728-9907-d88a43d325ab tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:10.169736 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6422378e-bf1a-4728-9907-d88a43d325ab tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:10.170407 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6422378e-bf1a-4728-9907-d88a43d325ab tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:10.171838 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6422378e-bf1a-4728-9907-d88a43d325ab tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:10.172530 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6422378e-bf1a-4728-9907-d88a43d325ab tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:10.369027 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-6422378e-bf1a-4728-9907-d88a43d325ab tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:10.373622 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-2182d64c-2d7a-4b79-b97e-cb01ec278ca3 req-f01f0e5a-7427-4119-9665-fcd23b49f8a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f15090-8fe0-4ebd-b4e6-2aad101f417b", "tag": "8914df61-0be3-41f5-849d-98c808f21db2"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:37:10.386842 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-6422378e-bf1a-4728-9907-d88a43d325ab tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1322 microversion: 2.1 time: 0.231651 May 25 07:37:10.397023 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 38/90] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:10 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1322 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:10.397714 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-2182d64c-2d7a-4b79-b97e-cb01ec278ca3 req-f01f0e5a-7427-4119-9665-fcd23b49f8a8 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:10.397714 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-2182d64c-2d7a-4b79-b97e-cb01ec278ca3 req-f01f0e5a-7427-4119-9665-fcd23b49f8a8 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:10.420403 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-2182d64c-2d7a-4b79-b97e-cb01ec278ca3 req-f01f0e5a-7427-4119-9665-fcd23b49f8a8 service nova] Creating event network-changed:8914df61-0be3-41f5-849d-98c808f21db2 for instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b on hv-cinder-82549 May 25 07:37:10.437892 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-2182d64c-2d7a-4b79-b97e-cb01ec278ca3 req-f01f0e5a-7427-4119-9665-fcd23b49f8a8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.066810 May 25 07:37:10.438946 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 53/91] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:37:10.511507 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-870b0518-6030-421d-93f4-86b4a92139c7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:10.511507 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-870b0518-6030-421d-93f4-86b4a92139c7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:10.521020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-870b0518-6030-421d-93f4-86b4a92139c7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:10.526367 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-870b0518-6030-421d-93f4-86b4a92139c7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:10.527209 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-870b0518-6030-421d-93f4-86b4a92139c7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:10.527653 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-870b0518-6030-421d-93f4-86b4a92139c7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:10.557043 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=100 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:10.753730 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-7914c8d2-359d-48da-ab25-d0199b4337c4 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:10.754445 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-7914c8d2-359d-48da-ab25-d0199b4337c4 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:10.763886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7914c8d2-359d-48da-ab25-d0199b4337c4 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:10.764346 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7914c8d2-359d-48da-ab25-d0199b4337c4 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:10.765928 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7914c8d2-359d-48da-ab25-d0199b4337c4 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:10.766382 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7914c8d2-359d-48da-ab25-d0199b4337c4 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:10.966284 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-7914c8d2-359d-48da-ab25-d0199b4337c4 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:10.979778 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-7914c8d2-359d-48da-ab25-d0199b4337c4 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1315 microversion: 2.1 time: 0.232300 May 25 07:37:10.980630 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 54/92] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:10 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:37:10.993422 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-47c3ac44-40ec-4620-83a1-691467e72f8a req-23f125fa-e7cb-4354-96d3-4e62dbdc8075 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d5a90d7-311f-4e4a-84c2-ff14c0440bd2", "name": "network-vif-plugged", "status": "completed", "tag": "37369604-0009-4591-97a8-6e3c90d97049"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:37:11.008748 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-47c3ac44-40ec-4620-83a1-691467e72f8a req-23f125fa-e7cb-4354-96d3-4e62dbdc8075 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:11.009219 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-47c3ac44-40ec-4620-83a1-691467e72f8a req-23f125fa-e7cb-4354-96d3-4e62dbdc8075 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:11.020865 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-47c3ac44-40ec-4620-83a1-691467e72f8a req-23f125fa-e7cb-4354-96d3-4e62dbdc8075 service nova] Creating event network-vif-plugged:37369604-0009-4591-97a8-6e3c90d97049 for instance 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 on hv-cinder-82549 May 25 07:37:11.025836 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-47c3ac44-40ec-4620-83a1-691467e72f8a req-23f125fa-e7cb-4354-96d3-4e62dbdc8075 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043583 May 25 07:37:11.026681 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 55/93] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:37:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:37:11.032096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b870b94f-eb78-436c-b3f8-a54bb4580f05 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:11.033044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b870b94f-eb78-436c-b3f8-a54bb4580f05 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:11.039547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b870b94f-eb78-436c-b3f8-a54bb4580f05 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:11.040231 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b870b94f-eb78-436c-b3f8-a54bb4580f05 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:11.041212 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b870b94f-eb78-436c-b3f8-a54bb4580f05 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:11.041795 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b870b94f-eb78-436c-b3f8-a54bb4580f05 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:11.066262 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=4 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:11.167239 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-870b0518-6030-421d-93f4-86b4a92139c7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:11.176191 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-870b0518-6030-421d-93f4-86b4a92139c7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1363 microversion: 2.1 time: 0.672779 May 25 07:37:11.179784 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 39/94] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:10 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1363 bytes in 677 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:11.189988 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-6d1815e8-4bb6-41aa-b81f-9749e838ddba tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:11.192073 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-6d1815e8-4bb6-41aa-b81f-9749e838ddba tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:11.203223 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6d1815e8-4bb6-41aa-b81f-9749e838ddba tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:11.203875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6d1815e8-4bb6-41aa-b81f-9749e838ddba tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:11.204970 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6d1815e8-4bb6-41aa-b81f-9749e838ddba tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:11.205932 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6d1815e8-4bb6-41aa-b81f-9749e838ddba tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:11.532948 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-6d1815e8-4bb6-41aa-b81f-9749e838ddba tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:11.566016 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-6d1815e8-4bb6-41aa-b81f-9749e838ddba tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:11.571148 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-6d1815e8-4bb6-41aa-b81f-9749e838ddba tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:11.572430 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-6d1815e8-4bb6-41aa-b81f-9749e838ddba tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1405 microversion: 2.20 time: 0.389277 May 25 07:37:11.573250 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 40/95] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:37:11 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1405 bytes in 390 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:37:11.577727 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-4d30e3ce-7e36-423b-9112-f310be0af373 req-01cc98b6-29ab-4db2-a6d1-895755ca8785 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d360341-449d-4b49-8b66-a02a969171fd", "tag": "5b9220dd-eeaa-4ea1-a0cd-e54c1dbfe455"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:37:11.633397 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-4d30e3ce-7e36-423b-9112-f310be0af373 req-01cc98b6-29ab-4db2-a6d1-895755ca8785 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:11.633853 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-4d30e3ce-7e36-423b-9112-f310be0af373 req-01cc98b6-29ab-4db2-a6d1-895755ca8785 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:11.678327 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-4d30e3ce-7e36-423b-9112-f310be0af373 req-01cc98b6-29ab-4db2-a6d1-895755ca8785 service nova] Creating event network-changed:5b9220dd-eeaa-4ea1-a0cd-e54c1dbfe455 for instance 6d360341-449d-4b49-8b66-a02a969171fd on hv-cinder-82549 May 25 07:37:11.692873 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-4d30e3ce-7e36-423b-9112-f310be0af373 req-01cc98b6-29ab-4db2-a6d1-895755ca8785 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.117815 May 25 07:37:11.693671 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 41/96] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:37:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:37:11.704309 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-92eeebeb-02ab-4ce4-94d6-f3674d2080f4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:11.705051 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-92eeebeb-02ab-4ce4-94d6-f3674d2080f4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:11.721048 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-92eeebeb-02ab-4ce4-94d6-f3674d2080f4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:11.721494 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-92eeebeb-02ab-4ce4-94d6-f3674d2080f4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:11.738306 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-92eeebeb-02ab-4ce4-94d6-f3674d2080f4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:11.738306 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-92eeebeb-02ab-4ce4-94d6-f3674d2080f4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:11.976004 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b870b94f-eb78-436c-b3f8-a54bb4580f05 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:11.986716 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b870b94f-eb78-436c-b3f8-a54bb4580f05 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1363 microversion: 2.1 time: 0.958524 May 25 07:37:11.988364 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 56/97] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:11 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1363 bytes in 961 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:12.006231 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-197b28b6-1c52-4230-8a62-e34b12360db7 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:12.008031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-197b28b6-1c52-4230-8a62-e34b12360db7 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:12.016130 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-197b28b6-1c52-4230-8a62-e34b12360db7 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:12.016982 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-197b28b6-1c52-4230-8a62-e34b12360db7 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:12.017772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-197b28b6-1c52-4230-8a62-e34b12360db7 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:12.018205 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-197b28b6-1c52-4230-8a62-e34b12360db7 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:12.160334 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-197b28b6-1c52-4230-8a62-e34b12360db7 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:12.168151 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-197b28b6-1c52-4230-8a62-e34b12360db7 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1502 microversion: 2.1 time: 0.174489 May 25 07:37:12.181340 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 57/98] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:11 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1502 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:12.197055 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-c938ca50-36f2-4343-bcad-fbd08a7f6335 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:12.197707 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-c938ca50-36f2-4343-bcad-fbd08a7f6335 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:12.205154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c938ca50-36f2-4343-bcad-fbd08a7f6335 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:12.205611 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c938ca50-36f2-4343-bcad-fbd08a7f6335 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:12.206409 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c938ca50-36f2-4343-bcad-fbd08a7f6335 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:12.206845 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c938ca50-36f2-4343-bcad-fbd08a7f6335 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:12.242437 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-92eeebeb-02ab-4ce4-94d6-f3674d2080f4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:12.250383 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-92eeebeb-02ab-4ce4-94d6-f3674d2080f4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1322 microversion: 2.1 time: 0.555421 May 25 07:37:12.251094 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 42/99] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:11 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1322 bytes in 557 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:12.365488 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-c938ca50-36f2-4343-bcad-fbd08a7f6335 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:12.372896 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-c938ca50-36f2-4343-bcad-fbd08a7f6335 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1363 microversion: 2.1 time: 0.179585 May 25 07:37:12.373469 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 58/100] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:12 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1363 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:12.590295 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-5c105e14-9576-4d98-b4fc-dc1961f63d4e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:12.591560 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-5c105e14-9576-4d98-b4fc-dc1961f63d4e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:12.597033 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=12 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:12.603703 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5c105e14-9576-4d98-b4fc-dc1961f63d4e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:12.603703 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5c105e14-9576-4d98-b4fc-dc1961f63d4e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:12.603703 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5c105e14-9576-4d98-b4fc-dc1961f63d4e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:12.603703 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5c105e14-9576-4d98-b4fc-dc1961f63d4e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:12.919846 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-5c105e14-9576-4d98-b4fc-dc1961f63d4e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:12.928847 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-5c105e14-9576-4d98-b4fc-dc1961f63d4e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:12.930414 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-5c105e14-9576-4d98-b4fc-dc1961f63d4e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:12.931697 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-5c105e14-9576-4d98-b4fc-dc1961f63d4e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1405 microversion: 2.20 time: 0.345506 May 25 07:37:12.944462 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 43/101] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:37:12 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1405 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:37:13.005214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-eb2bb222-d3a8-433a-a092-06b3ffb76f14 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:13.005846 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-eb2bb222-d3a8-433a-a092-06b3ffb76f14 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:13.012611 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eb2bb222-d3a8-433a-a092-06b3ffb76f14 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:13.013893 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eb2bb222-d3a8-433a-a092-06b3ffb76f14 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:13.014871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eb2bb222-d3a8-433a-a092-06b3ffb76f14 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:13.015547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eb2bb222-d3a8-433a-a092-06b3ffb76f14 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:13.064999 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-f8be9bdc-2dc8-4437-8918-0d2f5ca274eb req-7386318d-2206-4eed-a809-8de6eaf23cd2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f652bc42-42f2-4664-b614-603b3ddf84b1", "name": "network-vif-plugged", "status": "completed", "tag": "5d521607-ce1e-41b4-a067-fdc197d09700"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:37:13.075085 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-f8be9bdc-2dc8-4437-8918-0d2f5ca274eb req-7386318d-2206-4eed-a809-8de6eaf23cd2 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:13.075688 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-f8be9bdc-2dc8-4437-8918-0d2f5ca274eb req-7386318d-2206-4eed-a809-8de6eaf23cd2 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:13.088893 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-f8be9bdc-2dc8-4437-8918-0d2f5ca274eb req-7386318d-2206-4eed-a809-8de6eaf23cd2 service nova] Creating event network-vif-plugged:5d521607-ce1e-41b4-a067-fdc197d09700 for instance f652bc42-42f2-4664-b614-603b3ddf84b1 on hv-cinder-82549 May 25 07:37:13.112183 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-f8be9bdc-2dc8-4437-8918-0d2f5ca274eb req-7386318d-2206-4eed-a809-8de6eaf23cd2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052232 May 25 07:37:13.112964 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 44/102] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:37:13.180302 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-eb2bb222-d3a8-433a-a092-06b3ffb76f14 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:13.185035 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-eb2bb222-d3a8-433a-a092-06b3ffb76f14 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1363 microversion: 2.1 time: 0.183951 May 25 07:37:13.185614 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 59/103] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:12 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1363 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:13.269019 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d2b1eb01-f569-4c35-b7c3-56f1c0afb218 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:13.269732 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d2b1eb01-f569-4c35-b7c3-56f1c0afb218 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:13.275979 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d2b1eb01-f569-4c35-b7c3-56f1c0afb218 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:13.276518 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d2b1eb01-f569-4c35-b7c3-56f1c0afb218 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:13.277355 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d2b1eb01-f569-4c35-b7c3-56f1c0afb218 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:13.277838 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d2b1eb01-f569-4c35-b7c3-56f1c0afb218 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:13.391665 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-1d162fa9-d645-414c-bef8-a5ad71d6947d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:13.392277 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-1d162fa9-d645-414c-bef8-a5ad71d6947d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:13.398305 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1d162fa9-d645-414c-bef8-a5ad71d6947d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:13.398758 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1d162fa9-d645-414c-bef8-a5ad71d6947d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:13.399530 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1d162fa9-d645-414c-bef8-a5ad71d6947d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:13.399966 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1d162fa9-d645-414c-bef8-a5ad71d6947d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:13.416382 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d2b1eb01-f569-4c35-b7c3-56f1c0afb218 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:13.420251 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=100 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:13.424366 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d2b1eb01-f569-4c35-b7c3-56f1c0afb218 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1322 microversion: 2.1 time: 0.160867 May 25 07:37:13.425041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 45/104] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:13 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1322 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:13.548679 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-1d162fa9-d645-414c-bef8-a5ad71d6947d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:13.556154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-1d162fa9-d645-414c-bef8-a5ad71d6947d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1363 microversion: 2.1 time: 0.169172 May 25 07:37:13.556764 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 60/105] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:13 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1363 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:37:13.725346 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-383e9850-6bb6-4c46-853e-46a2366a5723 req-5028e3a6-3a0c-44d1-a7a4-a5ce090dee42 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b10bee-95b1-4bfb-a9c5-6c15db78ba25", "tag": "afc7174b-1940-457e-9abc-fe45a8d98d61"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:37:13.733457 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-383e9850-6bb6-4c46-853e-46a2366a5723 req-5028e3a6-3a0c-44d1-a7a4-a5ce090dee42 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:13.734029 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-383e9850-6bb6-4c46-853e-46a2366a5723 req-5028e3a6-3a0c-44d1-a7a4-a5ce090dee42 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:13.744823 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-383e9850-6bb6-4c46-853e-46a2366a5723 req-5028e3a6-3a0c-44d1-a7a4-a5ce090dee42 service nova] Creating event network-changed:afc7174b-1940-457e-9abc-fe45a8d98d61 for instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 on hv-cinder-82549 May 25 07:37:13.750649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-383e9850-6bb6-4c46-853e-46a2366a5723 req-5028e3a6-3a0c-44d1-a7a4-a5ce090dee42 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028873 May 25 07:37:13.751315 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 46/106] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:37:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:37:13.968027 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-dab6999a-ea76-4813-ad62-0c26151a3e37 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:13.968942 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-dab6999a-ea76-4813-ad62-0c26151a3e37 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:13.970995 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=14 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:13.978997 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dab6999a-ea76-4813-ad62-0c26151a3e37 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:13.979842 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dab6999a-ea76-4813-ad62-0c26151a3e37 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:13.980746 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dab6999a-ea76-4813-ad62-0c26151a3e37 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:13.981920 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dab6999a-ea76-4813-ad62-0c26151a3e37 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:14.151787 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-dab6999a-ea76-4813-ad62-0c26151a3e37 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:14.159926 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-dab6999a-ea76-4813-ad62-0c26151a3e37 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:14.161575 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-dab6999a-ea76-4813-ad62-0c26151a3e37 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:14.162920 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-dab6999a-ea76-4813-ad62-0c26151a3e37 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1405 microversion: 2.20 time: 0.212378 May 25 07:37:14.163983 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 61/107] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:37:13 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1405 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:37:14.202678 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-bcacb0b2-0324-467a-a1d5-1ef93f8d2559 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:14.203855 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-bcacb0b2-0324-467a-a1d5-1ef93f8d2559 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:14.211066 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bcacb0b2-0324-467a-a1d5-1ef93f8d2559 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:14.211626 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bcacb0b2-0324-467a-a1d5-1ef93f8d2559 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:14.212569 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bcacb0b2-0324-467a-a1d5-1ef93f8d2559 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:14.213107 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bcacb0b2-0324-467a-a1d5-1ef93f8d2559 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:14.350599 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-bcacb0b2-0324-467a-a1d5-1ef93f8d2559 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:14.358463 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-bcacb0b2-0324-467a-a1d5-1ef93f8d2559 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1363 microversion: 2.1 time: 0.160532 May 25 07:37:14.359699 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 47/108] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:14 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1363 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:14.441177 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-1682ae81-d730-4919-9a72-3620eaeb4ea9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:14.441780 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-1682ae81-d730-4919-9a72-3620eaeb4ea9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:14.447638 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1682ae81-d730-4919-9a72-3620eaeb4ea9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:14.448133 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1682ae81-d730-4919-9a72-3620eaeb4ea9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:14.448918 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1682ae81-d730-4919-9a72-3620eaeb4ea9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:14.449354 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1682ae81-d730-4919-9a72-3620eaeb4ea9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:14.575075 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-157d7030-b372-478d-9913-3eba6c2146af tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:14.575600 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-157d7030-b372-478d-9913-3eba6c2146af tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:14.582189 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-157d7030-b372-478d-9913-3eba6c2146af tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:14.582634 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-157d7030-b372-478d-9913-3eba6c2146af tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:14.583582 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-157d7030-b372-478d-9913-3eba6c2146af tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:14.584062 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-157d7030-b372-478d-9913-3eba6c2146af tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:14.591146 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-1682ae81-d730-4919-9a72-3620eaeb4ea9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:14.599526 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-1682ae81-d730-4919-9a72-3620eaeb4ea9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1322 microversion: 2.1 time: 0.162092 May 25 07:37:14.600158 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 62/109] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:14 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1322 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:14.757981 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-157d7030-b372-478d-9913-3eba6c2146af tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:14.767216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-157d7030-b372-478d-9913-3eba6c2146af tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1363 microversion: 2.1 time: 0.196160 May 25 07:37:14.767818 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 48/110] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:14 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1363 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:15.065813 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-bf628a32-602a-42e9-b703-a03d27fa381f tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc0cf511-17b8-4e90-8d8f-643e797bc6ac"}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:37:15.067109 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-bf628a32-602a-42e9-b703-a03d27fa381f tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:15.073270 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-bf628a32-602a-42e9-b703-a03d27fa381f tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:15.073724 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-bf628a32-602a-42e9-b703-a03d27fa381f tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:15.074491 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-bf628a32-602a-42e9-b703-a03d27fa381f tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:15.075090 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-bf628a32-602a-42e9-b703-a03d27fa381f tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:15.182617 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1d99e1f0-acd2-49fd-abeb-5fcdc1008bd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:15.183240 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-1d99e1f0-acd2-49fd-abeb-5fcdc1008bd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:15.191757 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1d99e1f0-acd2-49fd-abeb-5fcdc1008bd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:15.192212 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1d99e1f0-acd2-49fd-abeb-5fcdc1008bd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:15.193046 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1d99e1f0-acd2-49fd-abeb-5fcdc1008bd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:15.193650 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1d99e1f0-acd2-49fd-abeb-5fcdc1008bd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:15.417126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1d99e1f0-acd2-49fd-abeb-5fcdc1008bd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:15.427117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1d99e1f0-acd2-49fd-abeb-5fcdc1008bd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:15.428730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1d99e1f0-acd2-49fd-abeb-5fcdc1008bd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:15.441595 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-1d99e1f0-acd2-49fd-abeb-5fcdc1008bd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1405 microversion: 2.20 time: 0.251239 May 25 07:37:15.441595 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 49/111] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:37:15 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1405 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:37:15.441595 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-23fe5b4f-6f56-4ff1-8f99-27631a5dcb1e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:15.441595 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-23fe5b4f-6f56-4ff1-8f99-27631a5dcb1e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:15.442354 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-23fe5b4f-6f56-4ff1-8f99-27631a5dcb1e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:15.442828 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-23fe5b4f-6f56-4ff1-8f99-27631a5dcb1e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:15.443587 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-23fe5b4f-6f56-4ff1-8f99-27631a5dcb1e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:15.444097 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-23fe5b4f-6f56-4ff1-8f99-27631a5dcb1e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:15.594321 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-23fe5b4f-6f56-4ff1-8f99-27631a5dcb1e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:15.611952 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-23fe5b4f-6f56-4ff1-8f99-27631a5dcb1e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1363 microversion: 2.1 time: 0.180126 May 25 07:37:15.612976 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 50/112] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:15 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1363 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:15.619148 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-349d9694-9a7f-4fd7-9dec-18d382b93c45 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:15.620017 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-349d9694-9a7f-4fd7-9dec-18d382b93c45 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:15.630646 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-349d9694-9a7f-4fd7-9dec-18d382b93c45 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:15.631636 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-349d9694-9a7f-4fd7-9dec-18d382b93c45 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:15.633156 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-349d9694-9a7f-4fd7-9dec-18d382b93c45 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:15.634125 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-349d9694-9a7f-4fd7-9dec-18d382b93c45 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:15.782138 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-349d9694-9a7f-4fd7-9dec-18d382b93c45 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:15.789671 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-349d9694-9a7f-4fd7-9dec-18d382b93c45 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1322 microversion: 2.1 time: 0.175284 May 25 07:37:15.790244 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 51/113] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:15 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1322 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:15.796829 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1f2d5fa3-586e-46fb-8aae-abcd2e6a3088 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:15.797530 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-1f2d5fa3-586e-46fb-8aae-abcd2e6a3088 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:15.803723 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1f2d5fa3-586e-46fb-8aae-abcd2e6a3088 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:15.804179 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1f2d5fa3-586e-46fb-8aae-abcd2e6a3088 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:15.804983 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1f2d5fa3-586e-46fb-8aae-abcd2e6a3088 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:15.805453 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1f2d5fa3-586e-46fb-8aae-abcd2e6a3088 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:15.933004 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1f2d5fa3-586e-46fb-8aae-abcd2e6a3088 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:15.940503 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-1f2d5fa3-586e-46fb-8aae-abcd2e6a3088 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1363 microversion: 2.1 time: 0.149166 May 25 07:37:15.941074 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 52/114] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:15 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1363 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:16.447447 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-8a5934f5-b644-46e3-ba13-6f7b453a5638 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:16.448305 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-8a5934f5-b644-46e3-ba13-6f7b453a5638 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:16.459314 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8a5934f5-b644-46e3-ba13-6f7b453a5638 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:16.461188 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8a5934f5-b644-46e3-ba13-6f7b453a5638 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:16.462027 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8a5934f5-b644-46e3-ba13-6f7b453a5638 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:16.462469 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8a5934f5-b644-46e3-ba13-6f7b453a5638 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:16.690359 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-8a5934f5-b644-46e3-ba13-6f7b453a5638 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:16.699094 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-8a5934f5-b644-46e3-ba13-6f7b453a5638 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:16.700703 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-8a5934f5-b644-46e3-ba13-6f7b453a5638 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:16.702123 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-8a5934f5-b644-46e3-ba13-6f7b453a5638 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1405 microversion: 2.20 time: 0.258574 May 25 07:37:16.703655 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 53/115] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:37:16 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1405 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:37:16.714394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-3166b34e-2f03-4ff8-9bd4-176bf0ba9788 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:16.715002 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-3166b34e-2f03-4ff8-9bd4-176bf0ba9788 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:16.721355 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3166b34e-2f03-4ff8-9bd4-176bf0ba9788 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:16.721797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3166b34e-2f03-4ff8-9bd4-176bf0ba9788 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:16.722854 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3166b34e-2f03-4ff8-9bd4-176bf0ba9788 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:16.723488 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3166b34e-2f03-4ff8-9bd4-176bf0ba9788 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:16.976514 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-3166b34e-2f03-4ff8-9bd4-176bf0ba9788 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:16.984952 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-3166b34e-2f03-4ff8-9bd4-176bf0ba9788 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1363 microversion: 2.1 time: 0.280134 May 25 07:37:16.985529 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 54/116] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:16 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1363 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:16.990159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-598e4e65-e0b8-42ac-a727-28f727abcdb9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:16.990968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-598e4e65-e0b8-42ac-a727-28f727abcdb9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:16.998633 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-598e4e65-e0b8-42ac-a727-28f727abcdb9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:16.999084 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-598e4e65-e0b8-42ac-a727-28f727abcdb9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:17.000818 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-598e4e65-e0b8-42ac-a727-28f727abcdb9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:17.001251 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-598e4e65-e0b8-42ac-a727-28f727abcdb9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:17.215547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-bf628a32-602a-42e9-b703-a03d27fa381f tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "POST /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.154372 May 25 07:37:17.216062 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-598e4e65-e0b8-42ac-a727-28f727abcdb9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:17.223011 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 63/117] 10.222.0.24 () {60 vars in 1322 bytes} [Wed May 25 07:37:15 2022] POST /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40/os-volume_attachments => generated 194 bytes in 2163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:37:17.224510 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-598e4e65-e0b8-42ac-a727-28f727abcdb9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1322 microversion: 2.1 time: 0.237856 May 25 07:37:17.229431 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ec5be4ca-3cc1-41a6-a6fb-6c039b6f7f41 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:17.230360 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ec5be4ca-3cc1-41a6-a6fb-6c039b6f7f41 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:17.234233 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 55/118] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:16 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1322 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:17.239506 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ec5be4ca-3cc1-41a6-a6fb-6c039b6f7f41 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:17.240129 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ec5be4ca-3cc1-41a6-a6fb-6c039b6f7f41 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:17.240956 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ec5be4ca-3cc1-41a6-a6fb-6c039b6f7f41 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:17.241422 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ec5be4ca-3cc1-41a6-a6fb-6c039b6f7f41 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:17.429508 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ec5be4ca-3cc1-41a6-a6fb-6c039b6f7f41 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:17.439877 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ec5be4ca-3cc1-41a6-a6fb-6c039b6f7f41 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1363 microversion: 2.1 time: 0.215355 May 25 07:37:17.440667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 64/119] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:17 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1363 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:17.722657 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-61560550-d297-450c-bb95-62bf3fe01046 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:17.723290 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-61560550-d297-450c-bb95-62bf3fe01046 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:17.725591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=6 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:17.731864 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-61560550-d297-450c-bb95-62bf3fe01046 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:17.732322 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-61560550-d297-450c-bb95-62bf3fe01046 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:17.733268 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-61560550-d297-450c-bb95-62bf3fe01046 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:17.734557 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-61560550-d297-450c-bb95-62bf3fe01046 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:17.892600 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-61560550-d297-450c-bb95-62bf3fe01046 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:17.908314 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-61560550-d297-450c-bb95-62bf3fe01046 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:17.910752 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-61560550-d297-450c-bb95-62bf3fe01046 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:17.912654 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-61560550-d297-450c-bb95-62bf3fe01046 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1405 microversion: 2.20 time: 0.195068 May 25 07:37:17.913743 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 56/120] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:37:17 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:37:18.001757 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-1d0dd1b9-ca96-4e98-b009-a84ac39564c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:18.002383 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-1d0dd1b9-ca96-4e98-b009-a84ac39564c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:18.009314 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1d0dd1b9-ca96-4e98-b009-a84ac39564c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:18.009979 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1d0dd1b9-ca96-4e98-b009-a84ac39564c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:18.010755 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1d0dd1b9-ca96-4e98-b009-a84ac39564c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:18.011194 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1d0dd1b9-ca96-4e98-b009-a84ac39564c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:18.149792 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-1d0dd1b9-ca96-4e98-b009-a84ac39564c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:18.159647 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-1d0dd1b9-ca96-4e98-b009-a84ac39564c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1363 microversion: 2.1 time: 0.162516 May 25 07:37:18.160286 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 65/121] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:17 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1363 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:18.242057 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-fb065920-5245-44ad-a551-5ddf4ed5a3e6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:18.242933 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-fb065920-5245-44ad-a551-5ddf4ed5a3e6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:18.245990 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:18.250117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fb065920-5245-44ad-a551-5ddf4ed5a3e6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:18.250663 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fb065920-5245-44ad-a551-5ddf4ed5a3e6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:18.251625 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fb065920-5245-44ad-a551-5ddf4ed5a3e6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:18.252161 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fb065920-5245-44ad-a551-5ddf4ed5a3e6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:18.458659 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-e78fee76-c791-462b-9820-f33760216bc8 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:18.459488 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-e78fee76-c791-462b-9820-f33760216bc8 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:18.461877 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:18.467718 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e78fee76-c791-462b-9820-f33760216bc8 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:18.469216 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e78fee76-c791-462b-9820-f33760216bc8 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:18.470460 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e78fee76-c791-462b-9820-f33760216bc8 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:18.471143 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e78fee76-c791-462b-9820-f33760216bc8 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:18.673584 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-fb065920-5245-44ad-a551-5ddf4ed5a3e6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:18.695147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-fb065920-5245-44ad-a551-5ddf4ed5a3e6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1513 microversion: 2.1 time: 0.457525 May 25 07:37:18.695730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 57/122] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:18 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1513 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:37:18.717096 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-ee7e3a20-c1a2-482e-8d24-03a3c395ffed tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:37:18.718294 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-ee7e3a20-c1a2-482e-8d24-03a3c395ffed tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:18.724943 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ee7e3a20-c1a2-482e-8d24-03a3c395ffed tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:18.725823 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ee7e3a20-c1a2-482e-8d24-03a3c395ffed tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:18.726939 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ee7e3a20-c1a2-482e-8d24-03a3c395ffed tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:18.727502 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ee7e3a20-c1a2-482e-8d24-03a3c395ffed tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:18.750317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-e78fee76-c791-462b-9820-f33760216bc8 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:18.760899 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=100 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:18.764653 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-e78fee76-c791-462b-9820-f33760216bc8 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1363 microversion: 2.1 time: 0.308970 May 25 07:37:18.765395 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 66/123] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:18 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1363 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:37:18.805666 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.objects.instance [None req-ee7e3a20-c1a2-482e-8d24-03a3c395ffed tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lazy-loading 'flavor' on Instance uuid f652bc42-42f2-4664-b614-603b3ddf84b1 {{(pid=124674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:37:18.931504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-e15dcccb-39ff-4e3e-be1f-e3223750dbca tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:18.932125 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-e15dcccb-39ff-4e3e-be1f-e3223750dbca tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:18.939374 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e15dcccb-39ff-4e3e-be1f-e3223750dbca tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:18.939842 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e15dcccb-39ff-4e3e-be1f-e3223750dbca tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:18.940703 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e15dcccb-39ff-4e3e-be1f-e3223750dbca tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:18.941148 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e15dcccb-39ff-4e3e-be1f-e3223750dbca tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:19.118803 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-e15dcccb-39ff-4e3e-be1f-e3223750dbca tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:19.118803 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-e15dcccb-39ff-4e3e-be1f-e3223750dbca tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:19.119071 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-e15dcccb-39ff-4e3e-be1f-e3223750dbca tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:19.119762 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-e15dcccb-39ff-4e3e-be1f-e3223750dbca tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1405 microversion: 2.20 time: 0.192415 May 25 07:37:19.120330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 67/124] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:37:18 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1405 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:37:19.176459 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-f50624e9-fad9-40d8-a5ab-a4930e16ab0a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:19.177130 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-f50624e9-fad9-40d8-a5ab-a4930e16ab0a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:19.183448 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f50624e9-fad9-40d8-a5ab-a4930e16ab0a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:19.183916 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f50624e9-fad9-40d8-a5ab-a4930e16ab0a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:19.184717 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f50624e9-fad9-40d8-a5ab-a4930e16ab0a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:19.185208 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f50624e9-fad9-40d8-a5ab-a4930e16ab0a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:19.320462 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-f50624e9-fad9-40d8-a5ab-a4930e16ab0a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:19.331619 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-f50624e9-fad9-40d8-a5ab-a4930e16ab0a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1363 microversion: 2.1 time: 0.155823 May 25 07:37:19.333675 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 68/125] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:19 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:37:19.336569 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-ee7e3a20-c1a2-482e-8d24-03a3c395ffed tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "POST /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1/action" status: 200 len: 32 microversion: 2.1 time: 0.623986 May 25 07:37:19.338415 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 58/126] 10.222.0.24 () {60 vars in 1277 bytes} [Wed May 25 07:37:18 2022] POST /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1/action => generated 32 bytes in 626 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 25 07:37:19.353636 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-deece861-de24-46f9-bd62-579e3bd7c6cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:19.354519 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-deece861-de24-46f9-bd62-579e3bd7c6cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:19.362959 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-deece861-de24-46f9-bd62-579e3bd7c6cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:19.363455 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-deece861-de24-46f9-bd62-579e3bd7c6cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:19.364290 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-deece861-de24-46f9-bd62-579e3bd7c6cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:19.364790 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-deece861-de24-46f9-bd62-579e3bd7c6cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:19.516596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-deece861-de24-46f9-bd62-579e3bd7c6cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:19.527755 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-deece861-de24-46f9-bd62-579e3bd7c6cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.179390 May 25 07:37:19.531324 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 69/127] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:19 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:19.554549 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-671b0d0c-c55a-42e2-a38e-301e4ed2d86a req-bf03a7be-7a78-4ca2-9c0b-f0a2b4c189c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f15090-8fe0-4ebd-b4e6-2aad101f417b", "name": "network-vif-plugged", "status": "completed", "tag": "8914df61-0be3-41f5-849d-98c808f21db2"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:37:19.563257 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-671b0d0c-c55a-42e2-a38e-301e4ed2d86a req-bf03a7be-7a78-4ca2-9c0b-f0a2b4c189c9 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:19.563700 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-671b0d0c-c55a-42e2-a38e-301e4ed2d86a req-bf03a7be-7a78-4ca2-9c0b-f0a2b4c189c9 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:19.602119 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-671b0d0c-c55a-42e2-a38e-301e4ed2d86a req-bf03a7be-7a78-4ca2-9c0b-f0a2b4c189c9 service nova] Creating event network-vif-plugged:8914df61-0be3-41f5-849d-98c808f21db2 for instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b on hv-cinder-82549 May 25 07:37:19.610246 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-671b0d0c-c55a-42e2-a38e-301e4ed2d86a req-bf03a7be-7a78-4ca2-9c0b-f0a2b4c189c9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059469 May 25 07:37:19.611286 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 59/128] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:37:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:37:19.782719 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-874e59e0-480c-40bf-beb4-b7ea7ae0e27f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:19.783334 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-874e59e0-480c-40bf-beb4-b7ea7ae0e27f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:19.798055 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-874e59e0-480c-40bf-beb4-b7ea7ae0e27f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:19.800628 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-874e59e0-480c-40bf-beb4-b7ea7ae0e27f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:19.802997 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-874e59e0-480c-40bf-beb4-b7ea7ae0e27f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:19.803765 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-874e59e0-480c-40bf-beb4-b7ea7ae0e27f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:20.007004 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-874e59e0-480c-40bf-beb4-b7ea7ae0e27f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:20.023359 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-874e59e0-480c-40bf-beb4-b7ea7ae0e27f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1363 microversion: 2.1 time: 0.245293 May 25 07:37:20.023958 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 70/129] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:19 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1363 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:20.138871 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c596200e-f0d7-4da0-9602-4164f1f095ff tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:20.140445 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c596200e-f0d7-4da0-9602-4164f1f095ff tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:20.150422 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c596200e-f0d7-4da0-9602-4164f1f095ff tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:20.151008 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c596200e-f0d7-4da0-9602-4164f1f095ff tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:20.151984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c596200e-f0d7-4da0-9602-4164f1f095ff tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:20.152880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c596200e-f0d7-4da0-9602-4164f1f095ff tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:20.355408 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-2926aa04-15c5-49ae-adf3-690c1ce9e9d4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:20.359252 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-2926aa04-15c5-49ae-adf3-690c1ce9e9d4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:20.365870 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2926aa04-15c5-49ae-adf3-690c1ce9e9d4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:20.366661 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2926aa04-15c5-49ae-adf3-690c1ce9e9d4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:20.367657 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2926aa04-15c5-49ae-adf3-690c1ce9e9d4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:20.368341 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2926aa04-15c5-49ae-adf3-690c1ce9e9d4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:20.436636 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c596200e-f0d7-4da0-9602-4164f1f095ff tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:20.447457 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c596200e-f0d7-4da0-9602-4164f1f095ff tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:20.454313 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c596200e-f0d7-4da0-9602-4164f1f095ff tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:20.454313 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c596200e-f0d7-4da0-9602-4164f1f095ff tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1405 microversion: 2.20 time: 0.318145 May 25 07:37:20.454668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 60/130] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:37:20 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1405 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:37:20.517285 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-2926aa04-15c5-49ae-adf3-690c1ce9e9d4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:20.525093 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-2926aa04-15c5-49ae-adf3-690c1ce9e9d4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1363 microversion: 2.1 time: 0.173750 May 25 07:37:20.525668 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 71/131] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:20 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1363 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:20.545772 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-b5ef1c34-0644-419c-bd8d-b61b16b81051 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:20.547105 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-b5ef1c34-0644-419c-bd8d-b61b16b81051 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:20.552997 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b5ef1c34-0644-419c-bd8d-b61b16b81051 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:20.553445 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b5ef1c34-0644-419c-bd8d-b61b16b81051 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:20.554210 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b5ef1c34-0644-419c-bd8d-b61b16b81051 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:20.554641 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b5ef1c34-0644-419c-bd8d-b61b16b81051 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:20.706778 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-b5ef1c34-0644-419c-bd8d-b61b16b81051 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:20.717335 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-b5ef1c34-0644-419c-bd8d-b61b16b81051 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.174783 May 25 07:37:20.721855 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 61/132] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:20 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:21.042821 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-0199aee4-e9ce-4b7b-8f98-c5bc2093ba5d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:21.043439 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-0199aee4-e9ce-4b7b-8f98-c5bc2093ba5d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:21.050028 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0199aee4-e9ce-4b7b-8f98-c5bc2093ba5d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:21.050482 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0199aee4-e9ce-4b7b-8f98-c5bc2093ba5d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:21.051246 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0199aee4-e9ce-4b7b-8f98-c5bc2093ba5d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:21.051781 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0199aee4-e9ce-4b7b-8f98-c5bc2093ba5d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:21.185819 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-0199aee4-e9ce-4b7b-8f98-c5bc2093ba5d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:21.195795 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-0199aee4-e9ce-4b7b-8f98-c5bc2093ba5d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1363 microversion: 2.1 time: 0.158235 May 25 07:37:21.196490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 72/133] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:21 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:21.470073 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-486e0791-c8e9-4354-bd1a-8d4d1cc92dbb tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:21.470680 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-486e0791-c8e9-4354-bd1a-8d4d1cc92dbb tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:21.477188 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-486e0791-c8e9-4354-bd1a-8d4d1cc92dbb tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:21.477636 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-486e0791-c8e9-4354-bd1a-8d4d1cc92dbb tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:21.478397 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-486e0791-c8e9-4354-bd1a-8d4d1cc92dbb tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:21.479089 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-486e0791-c8e9-4354-bd1a-8d4d1cc92dbb tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:21.543000 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-dab90370-0704-42af-a6e1-96e9eb3dfa00 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:21.543624 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-dab90370-0704-42af-a6e1-96e9eb3dfa00 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:21.551461 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dab90370-0704-42af-a6e1-96e9eb3dfa00 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:21.559430 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dab90370-0704-42af-a6e1-96e9eb3dfa00 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:21.559430 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dab90370-0704-42af-a6e1-96e9eb3dfa00 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:21.559430 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dab90370-0704-42af-a6e1-96e9eb3dfa00 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:21.695805 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-486e0791-c8e9-4354-bd1a-8d4d1cc92dbb tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:21.707077 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-486e0791-c8e9-4354-bd1a-8d4d1cc92dbb tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:21.709575 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-486e0791-c8e9-4354-bd1a-8d4d1cc92dbb tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:21.713089 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-486e0791-c8e9-4354-bd1a-8d4d1cc92dbb tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1405 microversion: 2.20 time: 0.246689 May 25 07:37:21.713992 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 62/134] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:37:21 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1405 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:37:21.719185 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-5f1294f0-6cc2-4e61-a31b-d7ea1a67e515 req-3e75ad9e-3bc1-4de1-a836-8ce813c83d72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b10bee-95b1-4bfb-a9c5-6c15db78ba25", "name": "network-vif-plugged", "status": "completed", "tag": "afc7174b-1940-457e-9abc-fe45a8d98d61"}, {"server_uuid": "6d360341-449d-4b49-8b66-a02a969171fd", "name": "network-vif-plugged", "status": "completed", "tag": "5b9220dd-eeaa-4ea1-a0cd-e54c1dbfe455"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:37:21.739886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-dab90370-0704-42af-a6e1-96e9eb3dfa00 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:21.740253 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-5f1294f0-6cc2-4e61-a31b-d7ea1a67e515 req-3e75ad9e-3bc1-4de1-a836-8ce813c83d72 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:21.740912 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-5f1294f0-6cc2-4e61-a31b-d7ea1a67e515 req-3e75ad9e-3bc1-4de1-a836-8ce813c83d72 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:21.750202 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-dab90370-0704-42af-a6e1-96e9eb3dfa00 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1363 microversion: 2.1 time: 0.210748 May 25 07:37:21.750908 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 73/135] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:21 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1363 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:37:21.755751 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-28d0f7a9-28a8-4c44-b167-8cecc003a556 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:21.756366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-28d0f7a9-28a8-4c44-b167-8cecc003a556 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:21.761296 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-5f1294f0-6cc2-4e61-a31b-d7ea1a67e515 req-3e75ad9e-3bc1-4de1-a836-8ce813c83d72 service nova] Creating event network-vif-plugged:afc7174b-1940-457e-9abc-fe45a8d98d61 for instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 on hv-cinder-82549 May 25 07:37:21.761825 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-5f1294f0-6cc2-4e61-a31b-d7ea1a67e515 req-3e75ad9e-3bc1-4de1-a836-8ce813c83d72 service nova] Creating event network-vif-plugged:5b9220dd-eeaa-4ea1-a0cd-e54c1dbfe455 for instance 6d360341-449d-4b49-8b66-a02a969171fd on hv-cinder-82549 May 25 07:37:21.762667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-28d0f7a9-28a8-4c44-b167-8cecc003a556 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:21.763358 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-28d0f7a9-28a8-4c44-b167-8cecc003a556 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:21.764162 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-28d0f7a9-28a8-4c44-b167-8cecc003a556 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:21.764667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-28d0f7a9-28a8-4c44-b167-8cecc003a556 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:21.770273 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-5f1294f0-6cc2-4e61-a31b-d7ea1a67e515 req-3e75ad9e-3bc1-4de1-a836-8ce813c83d72 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.054874 May 25 07:37:21.772645 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 63/136] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:37:21 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:37:22.161823 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-28d0f7a9-28a8-4c44-b167-8cecc003a556 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:22.169913 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-28d0f7a9-28a8-4c44-b167-8cecc003a556 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.417868 May 25 07:37:22.180030 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 74/137] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:21 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 419 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:22.214798 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-f2e1c81b-4689-489c-86d5-a2d5df566425 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:22.215742 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-f2e1c81b-4689-489c-86d5-a2d5df566425 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:22.227590 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f2e1c81b-4689-489c-86d5-a2d5df566425 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:22.228040 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f2e1c81b-4689-489c-86d5-a2d5df566425 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:22.229093 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f2e1c81b-4689-489c-86d5-a2d5df566425 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:22.229526 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f2e1c81b-4689-489c-86d5-a2d5df566425 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:22.670725 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-f2e1c81b-4689-489c-86d5-a2d5df566425 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:22.685895 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-f2e1c81b-4689-489c-86d5-a2d5df566425 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1363 microversion: 2.1 time: 0.475560 May 25 07:37:22.687920 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 64/138] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:22 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1363 bytes in 479 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:22.733449 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-65859a80-2f67-4a21-b87f-249ebcdeee1c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:22.734595 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-65859a80-2f67-4a21-b87f-249ebcdeee1c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:22.742491 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-65859a80-2f67-4a21-b87f-249ebcdeee1c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:22.743324 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-65859a80-2f67-4a21-b87f-249ebcdeee1c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:22.744240 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-65859a80-2f67-4a21-b87f-249ebcdeee1c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:22.745416 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-65859a80-2f67-4a21-b87f-249ebcdeee1c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:22.771357 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-877f481b-dacf-4c5b-9338-cfc3376291e0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:22.774108 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-877f481b-dacf-4c5b-9338-cfc3376291e0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:22.789873 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-877f481b-dacf-4c5b-9338-cfc3376291e0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:22.790638 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-877f481b-dacf-4c5b-9338-cfc3376291e0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:22.791609 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-877f481b-dacf-4c5b-9338-cfc3376291e0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:22.792051 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-877f481b-dacf-4c5b-9338-cfc3376291e0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:22.893984 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-65859a80-2f67-4a21-b87f-249ebcdeee1c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:22.897319 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:22.902736 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-65859a80-2f67-4a21-b87f-249ebcdeee1c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:22.904696 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-65859a80-2f67-4a21-b87f-249ebcdeee1c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:22.905736 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-65859a80-2f67-4a21-b87f-249ebcdeee1c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1405 microversion: 2.20 time: 0.176787 May 25 07:37:22.906643 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 75/139] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:37:22 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1405 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:37:22.970394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-877f481b-dacf-4c5b-9338-cfc3376291e0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:22.978337 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-877f481b-dacf-4c5b-9338-cfc3376291e0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1553 microversion: 2.1 time: 0.214505 May 25 07:37:22.979161 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 65/140] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:22 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1553 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:22.997221 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-c42746e8-6050-4303-afef-eb9d1ac3604d tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:22.997731 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-c42746e8-6050-4303-afef-eb9d1ac3604d tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:23.005489 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c42746e8-6050-4303-afef-eb9d1ac3604d tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:23.005955 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c42746e8-6050-4303-afef-eb9d1ac3604d tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:23.006763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c42746e8-6050-4303-afef-eb9d1ac3604d tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:23.007445 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c42746e8-6050-4303-afef-eb9d1ac3604d tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:23.088683 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-c42746e8-6050-4303-afef-eb9d1ac3604d tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.096161 May 25 07:37:23.089275 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 76/141] 10.222.0.24 () {58 vars in 1274 bytes} [Wed May 25 07:37:22 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b/os-interface => generated 284 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:37:23.188711 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1d182c11-9a22-41d2-ab49-d9a85ab75321 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:23.189721 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-1d182c11-9a22-41d2-ab49-d9a85ab75321 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:23.197664 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1d182c11-9a22-41d2-ab49-d9a85ab75321 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:23.198345 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1d182c11-9a22-41d2-ab49-d9a85ab75321 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:23.199471 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1d182c11-9a22-41d2-ab49-d9a85ab75321 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:23.200083 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1d182c11-9a22-41d2-ab49-d9a85ab75321 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:23.345628 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1d182c11-9a22-41d2-ab49-d9a85ab75321 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:23.355389 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-1d182c11-9a22-41d2-ab49-d9a85ab75321 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.171875 May 25 07:37:23.365773 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 66/142] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:23 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:23.705134 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-01c3ecf0-a5a9-4911-8a6a-ae1e01b81e1e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:23.706083 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-01c3ecf0-a5a9-4911-8a6a-ae1e01b81e1e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:23.713636 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-01c3ecf0-a5a9-4911-8a6a-ae1e01b81e1e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:23.714382 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-01c3ecf0-a5a9-4911-8a6a-ae1e01b81e1e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:23.715453 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-01c3ecf0-a5a9-4911-8a6a-ae1e01b81e1e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:23.716778 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-01c3ecf0-a5a9-4911-8a6a-ae1e01b81e1e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:23.925773 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-09355e06-65b0-4f68-b54d-8d9e37aa88e6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:23.925773 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-09355e06-65b0-4f68-b54d-8d9e37aa88e6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:23.931968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-09355e06-65b0-4f68-b54d-8d9e37aa88e6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:23.932420 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-09355e06-65b0-4f68-b54d-8d9e37aa88e6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:23.933224 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-09355e06-65b0-4f68-b54d-8d9e37aa88e6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:23.933661 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-09355e06-65b0-4f68-b54d-8d9e37aa88e6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:23.944956 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-01c3ecf0-a5a9-4911-8a6a-ae1e01b81e1e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:23.965805 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-01c3ecf0-a5a9-4911-8a6a-ae1e01b81e1e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1363 microversion: 2.1 time: 0.265747 May 25 07:37:23.966415 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 77/143] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:23 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1363 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:24.105559 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-09355e06-65b0-4f68-b54d-8d9e37aa88e6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:24.118149 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-09355e06-65b0-4f68-b54d-8d9e37aa88e6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:24.126217 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-09355e06-65b0-4f68-b54d-8d9e37aa88e6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:24.130766 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-09355e06-65b0-4f68-b54d-8d9e37aa88e6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1405 microversion: 2.20 time: 0.207666 May 25 07:37:24.133301 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 67/144] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:37:23 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1405 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:37:24.372850 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a7bff9c0-a14e-446a-a222-4cface227884 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:24.373446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a7bff9c0-a14e-446a-a222-4cface227884 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:24.381218 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a7bff9c0-a14e-446a-a222-4cface227884 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:24.381696 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a7bff9c0-a14e-446a-a222-4cface227884 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:24.382476 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a7bff9c0-a14e-446a-a222-4cface227884 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:24.382989 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a7bff9c0-a14e-446a-a222-4cface227884 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:24.700867 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-3afc58f5-2274-4c1c-a740-77a3ebea0926 req-f191a96e-c305-48e9-9ca9-a57860a497c9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "f7f15090-8fe0-4ebd-b4e6-2aad101f417b", "tag": "8914df61-0be3-41f5-849d-98c808f21db2"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:37:24.715569 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-3afc58f5-2274-4c1c-a740-77a3ebea0926 req-f191a96e-c305-48e9-9ca9-a57860a497c9 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:24.719049 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-3afc58f5-2274-4c1c-a740-77a3ebea0926 req-f191a96e-c305-48e9-9ca9-a57860a497c9 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:24.746688 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-3afc58f5-2274-4c1c-a740-77a3ebea0926 req-f191a96e-c305-48e9-9ca9-a57860a497c9 service nova] Creating event network-changed:8914df61-0be3-41f5-849d-98c808f21db2 for instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b on hv-cinder-82549 May 25 07:37:24.770749 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a7bff9c0-a14e-446a-a222-4cface227884 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:24.778666 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a7bff9c0-a14e-446a-a222-4cface227884 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.409806 May 25 07:37:24.780527 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 78/145] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:24 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:37:24.791925 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-3afc58f5-2274-4c1c-a740-77a3ebea0926 req-f191a96e-c305-48e9-9ca9-a57860a497c9 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.095819 May 25 07:37:24.793288 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 68/146] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:37:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:37:24.983541 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a44d563c-28b5-49d0-9954-41865bf76e42 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:24.984290 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a44d563c-28b5-49d0-9954-41865bf76e42 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:24.990453 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a44d563c-28b5-49d0-9954-41865bf76e42 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:24.990966 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a44d563c-28b5-49d0-9954-41865bf76e42 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:24.991814 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a44d563c-28b5-49d0-9954-41865bf76e42 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:24.992313 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a44d563c-28b5-49d0-9954-41865bf76e42 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:25.158569 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-67ce6ef0-910c-4de0-8bad-dff2e98f54fa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:25.159373 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-67ce6ef0-910c-4de0-8bad-dff2e98f54fa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:25.170804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-67ce6ef0-910c-4de0-8bad-dff2e98f54fa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:25.172272 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-67ce6ef0-910c-4de0-8bad-dff2e98f54fa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:25.174700 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-67ce6ef0-910c-4de0-8bad-dff2e98f54fa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:25.175230 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-67ce6ef0-910c-4de0-8bad-dff2e98f54fa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:25.221775 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a44d563c-28b5-49d0-9954-41865bf76e42 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:25.232895 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a44d563c-28b5-49d0-9954-41865bf76e42 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1548 microversion: 2.1 time: 0.252138 May 25 07:37:25.235326 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 79/147] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:24 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1548 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:25.256879 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-139a36f5-b712-4a8e-9bfd-61e9de6fd3c4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:25.260078 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-139a36f5-b712-4a8e-9bfd-61e9de6fd3c4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:25.269101 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-139a36f5-b712-4a8e-9bfd-61e9de6fd3c4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:25.269556 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-139a36f5-b712-4a8e-9bfd-61e9de6fd3c4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:25.270341 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-139a36f5-b712-4a8e-9bfd-61e9de6fd3c4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:25.270777 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-139a36f5-b712-4a8e-9bfd-61e9de6fd3c4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:25.383509 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-139a36f5-b712-4a8e-9bfd-61e9de6fd3c4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.132177 May 25 07:37:25.392280 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 80/148] 10.222.0.24 () {58 vars in 1274 bytes} [Wed May 25 07:37:25 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25/os-interface => generated 284 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:37:25.429506 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-67ce6ef0-910c-4de0-8bad-dff2e98f54fa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:25.438177 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-67ce6ef0-910c-4de0-8bad-dff2e98f54fa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:25.440044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-67ce6ef0-910c-4de0-8bad-dff2e98f54fa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:25.441373 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-67ce6ef0-910c-4de0-8bad-dff2e98f54fa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1405 microversion: 2.20 time: 0.287886 May 25 07:37:25.454055 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 69/149] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:37:25 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1405 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:37:25.797770 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-56491f8d-5683-45ac-ae7e-75923bb581b5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:25.798388 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-56491f8d-5683-45ac-ae7e-75923bb581b5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:25.823542 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-56491f8d-5683-45ac-ae7e-75923bb581b5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:25.823991 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-56491f8d-5683-45ac-ae7e-75923bb581b5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:25.825002 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-56491f8d-5683-45ac-ae7e-75923bb581b5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:25.825447 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-56491f8d-5683-45ac-ae7e-75923bb581b5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:26.101868 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-56491f8d-5683-45ac-ae7e-75923bb581b5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:26.111150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-56491f8d-5683-45ac-ae7e-75923bb581b5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.318273 May 25 07:37:26.112108 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 81/150] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:25 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:26.460261 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-4a1e98b0-239b-4008-9ee8-57c0d4247869 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:26.461742 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-4a1e98b0-239b-4008-9ee8-57c0d4247869 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:26.471397 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4a1e98b0-239b-4008-9ee8-57c0d4247869 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:26.472199 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4a1e98b0-239b-4008-9ee8-57c0d4247869 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:26.473400 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4a1e98b0-239b-4008-9ee8-57c0d4247869 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:26.475375 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4a1e98b0-239b-4008-9ee8-57c0d4247869 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:26.650131 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-4a1e98b0-239b-4008-9ee8-57c0d4247869 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:26.661386 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-4a1e98b0-239b-4008-9ee8-57c0d4247869 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:26.663422 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-4a1e98b0-239b-4008-9ee8-57c0d4247869 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:26.664699 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-4a1e98b0-239b-4008-9ee8-57c0d4247869 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1598 microversion: 2.20 time: 0.209070 May 25 07:37:26.665321 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 70/151] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:37:26 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1598 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:37:26.686287 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-aca8abc6-7d2f-4eb9-96a1-fafe04a12e7f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:26.687290 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-aca8abc6-7d2f-4eb9-96a1-fafe04a12e7f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:26.698585 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-aca8abc6-7d2f-4eb9-96a1-fafe04a12e7f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:26.699083 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-aca8abc6-7d2f-4eb9-96a1-fafe04a12e7f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:26.700225 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-aca8abc6-7d2f-4eb9-96a1-fafe04a12e7f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:26.700868 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-aca8abc6-7d2f-4eb9-96a1-fafe04a12e7f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:26.811951 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-cb1b6dc3-102c-4e5f-8717-570827a3d941 req-ad72465f-7d30-4711-9c64-69089999ef35 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a8b10bee-95b1-4bfb-a9c5-6c15db78ba25", "tag": "afc7174b-1940-457e-9abc-fe45a8d98d61"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:37:26.815889 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-aca8abc6-7d2f-4eb9-96a1-fafe04a12e7f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.134317 May 25 07:37:26.823181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 82/152] 10.222.0.24 () {60 vars in 1315 bytes} [Wed May 25 07:37:26 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd/os-interface => generated 285 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 07:37:26.837479 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-cb1b6dc3-102c-4e5f-8717-570827a3d941 req-ad72465f-7d30-4711-9c64-69089999ef35 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:26.837940 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-cb1b6dc3-102c-4e5f-8717-570827a3d941 req-ad72465f-7d30-4711-9c64-69089999ef35 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:26.851014 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-cb1b6dc3-102c-4e5f-8717-570827a3d941 req-ad72465f-7d30-4711-9c64-69089999ef35 service nova] Creating event network-changed:afc7174b-1940-457e-9abc-fe45a8d98d61 for instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 on hv-cinder-82549 May 25 07:37:26.857549 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-cb1b6dc3-102c-4e5f-8717-570827a3d941 req-ad72465f-7d30-4711-9c64-69089999ef35 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.051340 May 25 07:37:26.858464 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 71/153] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:37:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:37:27.132897 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-e9792fcb-4328-4204-aa2d-b453f31b55eb tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:27.134639 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-e9792fcb-4328-4204-aa2d-b453f31b55eb tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:27.143541 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e9792fcb-4328-4204-aa2d-b453f31b55eb tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:27.143999 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e9792fcb-4328-4204-aa2d-b453f31b55eb tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:27.144814 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e9792fcb-4328-4204-aa2d-b453f31b55eb tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:27.145314 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e9792fcb-4328-4204-aa2d-b453f31b55eb tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:27.294419 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-e9792fcb-4328-4204-aa2d-b453f31b55eb tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:27.302887 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-e9792fcb-4328-4204-aa2d-b453f31b55eb tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.175152 May 25 07:37:27.303558 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 83/154] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:27 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:28.321978 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-43757e78-5e0a-4025-8b01-11d8ab7f76d8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:28.322748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-43757e78-5e0a-4025-8b01-11d8ab7f76d8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:28.354268 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-43757e78-5e0a-4025-8b01-11d8ab7f76d8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:28.354986 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-43757e78-5e0a-4025-8b01-11d8ab7f76d8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:28.355822 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-43757e78-5e0a-4025-8b01-11d8ab7f76d8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:28.359528 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-43757e78-5e0a-4025-8b01-11d8ab7f76d8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:28.809053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-43757e78-5e0a-4025-8b01-11d8ab7f76d8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:28.818845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-43757e78-5e0a-4025-8b01-11d8ab7f76d8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.501411 May 25 07:37:28.831954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 72/155] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:28 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:28.836687 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-4099815a-8f38-41d0-a44f-19b5ccdc5c65 req-1e0bfb02-9e5e-4784-8ec0-c81f8c415d19 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6d360341-449d-4b49-8b66-a02a969171fd", "tag": "5b9220dd-eeaa-4ea1-a0cd-e54c1dbfe455"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:37:28.846063 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-4099815a-8f38-41d0-a44f-19b5ccdc5c65 req-1e0bfb02-9e5e-4784-8ec0-c81f8c415d19 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:28.846510 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-4099815a-8f38-41d0-a44f-19b5ccdc5c65 req-1e0bfb02-9e5e-4784-8ec0-c81f8c415d19 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:28.857971 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-4099815a-8f38-41d0-a44f-19b5ccdc5c65 req-1e0bfb02-9e5e-4784-8ec0-c81f8c415d19 service nova] Creating event network-changed:5b9220dd-eeaa-4ea1-a0cd-e54c1dbfe455 for instance 6d360341-449d-4b49-8b66-a02a969171fd on hv-cinder-82549 May 25 07:37:28.864009 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-4099815a-8f38-41d0-a44f-19b5ccdc5c65 req-1e0bfb02-9e5e-4784-8ec0-c81f8c415d19 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031015 May 25 07:37:28.864767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 84/156] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:37:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:37:29.835422 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-e29a3282-bbbe-4e61-bf76-7caa685f5c97 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:29.836062 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-e29a3282-bbbe-4e61-bf76-7caa685f5c97 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:29.842426 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e29a3282-bbbe-4e61-bf76-7caa685f5c97 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:29.847278 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e29a3282-bbbe-4e61-bf76-7caa685f5c97 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:29.848335 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e29a3282-bbbe-4e61-bf76-7caa685f5c97 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:29.848961 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e29a3282-bbbe-4e61-bf76-7caa685f5c97 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:30.021157 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-e29a3282-bbbe-4e61-bf76-7caa685f5c97 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:30.030642 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-e29a3282-bbbe-4e61-bf76-7caa685f5c97 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.199185 May 25 07:37:30.035524 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 73/157] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:29 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:30.934399 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ea440792-9aa0-40e9-b666-2a46ec43eb48 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:30.935007 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ea440792-9aa0-40e9-b666-2a46ec43eb48 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:30.947280 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ea440792-9aa0-40e9-b666-2a46ec43eb48 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:30.948357 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ea440792-9aa0-40e9-b666-2a46ec43eb48 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:30.949819 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ea440792-9aa0-40e9-b666-2a46ec43eb48 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:30.955591 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ea440792-9aa0-40e9-b666-2a46ec43eb48 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:30.999341 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ea440792-9aa0-40e9-b666-2a46ec43eb48 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Going to try to terminate instance {{(pid=124675) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:37:31.053058 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-2adab5e8-a097-4360-b8e8-ac6ce71f1b73 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:31.053827 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-2adab5e8-a097-4360-b8e8-ac6ce71f1b73 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:31.062467 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2adab5e8-a097-4360-b8e8-ac6ce71f1b73 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:31.062467 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2adab5e8-a097-4360-b8e8-ac6ce71f1b73 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:31.063739 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2adab5e8-a097-4360-b8e8-ac6ce71f1b73 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:31.063739 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2adab5e8-a097-4360-b8e8-ac6ce71f1b73 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:31.210396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-2adab5e8-a097-4360-b8e8-ac6ce71f1b73 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:31.218898 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-2adab5e8-a097-4360-b8e8-ac6ce71f1b73 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.169016 May 25 07:37:31.220076 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 74/158] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:31 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:37:31.576923 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ea440792-9aa0-40e9-b666-2a46ec43eb48 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "DELETE /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 204 len: 0 microversion: 2.1 time: 0.647797 May 25 07:37:31.579833 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 85/159] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:37:30 2022] DELETE /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 0 bytes in 650 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 07:37:31.600657 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1c2d2c46-54a3-4a47-b731-9ca555e037ac tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:31.601337 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-1c2d2c46-54a3-4a47-b731-9ca555e037ac tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:31.610270 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1c2d2c46-54a3-4a47-b731-9ca555e037ac tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:31.613452 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1c2d2c46-54a3-4a47-b731-9ca555e037ac tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:31.613452 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1c2d2c46-54a3-4a47-b731-9ca555e037ac tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:31.613452 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1c2d2c46-54a3-4a47-b731-9ca555e037ac tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:31.628417 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:31.794433 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1c2d2c46-54a3-4a47-b731-9ca555e037ac tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:31.803516 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-1c2d2c46-54a3-4a47-b731-9ca555e037ac tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1554 microversion: 2.1 time: 0.215221 May 25 07:37:31.804154 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 75/160] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:31 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1554 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:32.248502 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-eb616257-78f3-487d-b5ae-4ae573c23778 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:32.268857 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-eb616257-78f3-487d-b5ae-4ae573c23778 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:32.268857 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eb616257-78f3-487d-b5ae-4ae573c23778 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:32.268857 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eb616257-78f3-487d-b5ae-4ae573c23778 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:32.268857 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eb616257-78f3-487d-b5ae-4ae573c23778 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:32.269864 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eb616257-78f3-487d-b5ae-4ae573c23778 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:32.418365 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-eb616257-78f3-487d-b5ae-4ae573c23778 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:32.432456 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-eb616257-78f3-487d-b5ae-4ae573c23778 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.185760 May 25 07:37:32.432456 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 86/161] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:32 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:32.828315 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-71b3e8a6-5577-47dd-9889-20b2a2edf84b tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:32.829117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-71b3e8a6-5577-47dd-9889-20b2a2edf84b tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:32.837307 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-71b3e8a6-5577-47dd-9889-20b2a2edf84b tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:32.837762 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-71b3e8a6-5577-47dd-9889-20b2a2edf84b tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:32.838719 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-71b3e8a6-5577-47dd-9889-20b2a2edf84b tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:32.839160 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-71b3e8a6-5577-47dd-9889-20b2a2edf84b tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:33.008273 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-71b3e8a6-5577-47dd-9889-20b2a2edf84b tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:33.018087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-71b3e8a6-5577-47dd-9889-20b2a2edf84b tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1554 microversion: 2.1 time: 0.197380 May 25 07:37:33.022296 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 76/162] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:32 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1554 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:33.447136 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8bba8f4d-fdb8-47f2-8536-1659cd211eb2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:33.447873 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-8bba8f4d-fdb8-47f2-8536-1659cd211eb2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:33.456216 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8bba8f4d-fdb8-47f2-8536-1659cd211eb2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:33.456704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8bba8f4d-fdb8-47f2-8536-1659cd211eb2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:33.458172 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8bba8f4d-fdb8-47f2-8536-1659cd211eb2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:33.458973 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8bba8f4d-fdb8-47f2-8536-1659cd211eb2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:33.626218 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-8bba8f4d-fdb8-47f2-8536-1659cd211eb2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:33.643721 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-8bba8f4d-fdb8-47f2-8536-1659cd211eb2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.200135 May 25 07:37:33.654240 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 87/163] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:33 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:34.036106 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c037b655-6180-4c6d-99ed-93f1a5870fdc tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:34.036761 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c037b655-6180-4c6d-99ed-93f1a5870fdc tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:34.043245 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c037b655-6180-4c6d-99ed-93f1a5870fdc tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:34.043767 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c037b655-6180-4c6d-99ed-93f1a5870fdc tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:34.044754 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c037b655-6180-4c6d-99ed-93f1a5870fdc tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:34.045141 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c037b655-6180-4c6d-99ed-93f1a5870fdc tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:34.232831 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c037b655-6180-4c6d-99ed-93f1a5870fdc tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:34.242583 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c037b655-6180-4c6d-99ed-93f1a5870fdc tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1554 microversion: 2.1 time: 0.210713 May 25 07:37:34.253660 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 77/164] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:34 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1554 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:34.661881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-14f3e000-8ee5-4cbf-a7f5-59e984b627aa tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:34.665592 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-14f3e000-8ee5-4cbf-a7f5-59e984b627aa tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:34.669956 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-14f3e000-8ee5-4cbf-a7f5-59e984b627aa tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:34.670440 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-14f3e000-8ee5-4cbf-a7f5-59e984b627aa tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:34.671259 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-14f3e000-8ee5-4cbf-a7f5-59e984b627aa tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:34.672314 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-14f3e000-8ee5-4cbf-a7f5-59e984b627aa tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:34.833411 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-14f3e000-8ee5-4cbf-a7f5-59e984b627aa tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:34.846360 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-14f3e000-8ee5-4cbf-a7f5-59e984b627aa tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.186291 May 25 07:37:34.846360 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 88/165] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:34 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:35.035088 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-2e625071-7165-4fb0-a659-6300def11b58 req-aeda403a-7c68-4dfd-8bc8-9ec3208198c6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "57fedc8c-b769-4f1d-b263-478dcb44da40", "name": "network-vif-deleted", "tag": "25dfc8d5-59b2-4523-b077-3638d5408b3d"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:37:35.064946 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-2e625071-7165-4fb0-a659-6300def11b58 req-aeda403a-7c68-4dfd-8bc8-9ec3208198c6 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:35.066289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-2e625071-7165-4fb0-a659-6300def11b58 req-aeda403a-7c68-4dfd-8bc8-9ec3208198c6 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.015s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:35.089134 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-2e625071-7165-4fb0-a659-6300def11b58 req-aeda403a-7c68-4dfd-8bc8-9ec3208198c6 service nova] Creating event network-vif-deleted:25dfc8d5-59b2-4523-b077-3638d5408b3d for instance 57fedc8c-b769-4f1d-b263-478dcb44da40 on hv-cinder-82549 May 25 07:37:35.096291 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-2e625071-7165-4fb0-a659-6300def11b58 req-aeda403a-7c68-4dfd-8bc8-9ec3208198c6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071744 May 25 07:37:35.099778 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 78/166] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:37:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:37:35.260812 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-83fa11b7-8b81-490e-8334-82ffd699a457 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:35.261503 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-83fa11b7-8b81-490e-8334-82ffd699a457 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:35.272995 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-83fa11b7-8b81-490e-8334-82ffd699a457 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:35.272995 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-83fa11b7-8b81-490e-8334-82ffd699a457 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:35.272995 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-83fa11b7-8b81-490e-8334-82ffd699a457 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:35.272995 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-83fa11b7-8b81-490e-8334-82ffd699a457 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:35.343673 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-83fa11b7-8b81-490e-8334-82ffd699a457 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:35.351934 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-83fa11b7-8b81-490e-8334-82ffd699a457 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1346 microversion: 2.1 time: 0.094996 May 25 07:37:35.352541 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 89/167] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:35 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1346 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:35.861750 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c2ad1116-90b7-4623-8239-367d853f57f1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:35.862457 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c2ad1116-90b7-4623-8239-367d853f57f1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:35.868658 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c2ad1116-90b7-4623-8239-367d853f57f1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:35.869117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c2ad1116-90b7-4623-8239-367d853f57f1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:35.869892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c2ad1116-90b7-4623-8239-367d853f57f1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:35.870333 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c2ad1116-90b7-4623-8239-367d853f57f1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:36.034506 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c2ad1116-90b7-4623-8239-367d853f57f1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:36.035902 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c2ad1116-90b7-4623-8239-367d853f57f1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.178955 May 25 07:37:36.036654 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 79/168] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:35 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:36.369600 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-da793876-c418-44cc-ac12-cf98be2e63b6 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:36.370147 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-da793876-c418-44cc-ac12-cf98be2e63b6 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:36.376301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-da793876-c418-44cc-ac12-cf98be2e63b6 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:36.376796 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-da793876-c418-44cc-ac12-cf98be2e63b6 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:36.377565 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-da793876-c418-44cc-ac12-cf98be2e63b6 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:36.378013 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-da793876-c418-44cc-ac12-cf98be2e63b6 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:36.409417 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-da793876-c418-44cc-ac12-cf98be2e63b6 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:36.409868 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-da793876-c418-44cc-ac12-cf98be2e63b6 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:36.410334 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.objects.instance [None req-da793876-c418-44cc-ac12-cf98be2e63b6 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lazy-loading 'fault' on Instance uuid 57fedc8c-b769-4f1d-b263-478dcb44da40 {{(pid=124675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:37:36.459528 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-da793876-c418-44cc-ac12-cf98be2e63b6 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '107da1af788341e4817a7038495f050c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '39578c81fb5b4b208039318217fdb3a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:36.467917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-da793876-c418-44cc-ac12-cf98be2e63b6 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 200 len: 1351 microversion: 2.1 time: 0.102772 May 25 07:37:36.468652 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 90/169] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:36 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 1351 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:37.054745 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-70396ae5-9307-4339-914c-7213c9cf932c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:37.055141 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-70396ae5-9307-4339-914c-7213c9cf932c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:37.062154 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-70396ae5-9307-4339-914c-7213c9cf932c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:37.062750 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-70396ae5-9307-4339-914c-7213c9cf932c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:37.069848 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-70396ae5-9307-4339-914c-7213c9cf932c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:37.069848 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-70396ae5-9307-4339-914c-7213c9cf932c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:37.246128 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-70396ae5-9307-4339-914c-7213c9cf932c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:37.254374 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-70396ae5-9307-4339-914c-7213c9cf932c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.204550 May 25 07:37:37.255135 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 80/170] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:37 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:37.486017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-26559d12-ef6c-463a-a725-71edfbf6848d tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:37.487348 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-26559d12-ef6c-463a-a725-71edfbf6848d tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:37.494238 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-26559d12-ef6c-463a-a725-71edfbf6848d tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:37.494697 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-26559d12-ef6c-463a-a725-71edfbf6848d tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:37.495502 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-26559d12-ef6c-463a-a725-71edfbf6848d tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:37.495945 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-26559d12-ef6c-463a-a725-71edfbf6848d tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:37.510648 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-26559d12-ef6c-463a-a725-71edfbf6848d tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] HTTP exception thrown: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. May 25 07:37:37.516184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-26559d12-ef6c-463a-a725-71edfbf6848d tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Request method failure captured: May 25 07:37:37.516184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 HTTP/1.1 May 25 07:37:37.516184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:37:37.516184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:37:37.516184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:37:37.516184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:37:37.516184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:37:37.516184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:37:37.516184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:37:37.516184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:37:37.516184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijdx8YMUMtTn7uwV83DbQHn749mgpe4pXZQXLuu2Gz2Tiy-xq8T10AKYI3I_0Yu8b0h92jVXFmBePojsxhuNRpYqLdoJahxalfmVmLBpt0Ta0BWIGjuBsX-gmgSdr7G76lKc6TfiFnnslWSR8006uua1lEVurcOiJ36QJJtSPy5RwYf8 May 25 07:37:37.516184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:37:37.516184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:37:37.516184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:37:37.516184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:37:37.516184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:37:37.516184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:37:37.516184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: 39578c81fb5b4b208039318217fdb3a2 May 25 07:37:37.516184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-DeleteServersTestJSON-1468466414 May 25 07:37:37.516184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:37:37.516184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:37:37.524515 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/39578c81fb5b4b208039318217fdb3a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/39578c81fb5b4b208039318217fdb3a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_39578c81fb5b4b208039318217fdb3a2", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/39578c81fb5b4b208039318217fdb3a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:37:37.524515 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-DeleteServersTestJSON-1468466414 May 25 07:37:37.524515 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: 39578c81fb5b4b208039318217fdb3a2 May 25 07:37:37.524515 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-DeleteServersTestJSON-1468466414 May 25 07:37:37.524515 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-DeleteServersTestJSON-1468466414-project May 25 07:37:37.524515 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:37:37.524515 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:37:37.524515 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: 107da1af788341e4817a7038495f050c May 25 07:37:37.524515 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-DeleteServersTestJSON-1468466414-project May 25 07:37:37.524515 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:37:37.524515 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. May 25 07:37:37.524515 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': '57fedc8c-b769-4f1d-b263-478dcb44da40'} May 25 07:37:37.525954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:37:37.525954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:37.525954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:37:37.525954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:37:37.525954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:37:37.525954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:37:37.525954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:37:37.525954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:37:37.525954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:37:37.525954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:37:37.525954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. May 25 07:37:37.525954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:37.525954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:37.525954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:37.525954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:37.525954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:37:37.525954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:37:37.525954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:37:37.525954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:37:37.525954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:37:37.527784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:37:37.527784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:37:37.527784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:37:37.527784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:37:37.527784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:37:37.527784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:37:37.527784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:37:37.527784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. May 25 07:37:37.527784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:37.527784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:37.527784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:37.527784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:37.527784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:37:37.527784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:37:37.527784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:37:37.527784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:37:37.527784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. May 25 07:37:37.527784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:37.529619 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-26559d12-ef6c-463a-a725-71edfbf6848d tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Returning 404 to user: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:37:37.529619 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-26559d12-ef6c-463a-a725-71edfbf6848d tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 404 len: 111 microversion: 2.1 time: 0.036229 May 25 07:37:37.529619 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 91/171] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:37 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:37:37.630878 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7aa93f09-be8b-4be2-8606-9a3f1a5220e0 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:37.631794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-7aa93f09-be8b-4be2-8606-9a3f1a5220e0 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:37.637980 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7aa93f09-be8b-4be2-8606-9a3f1a5220e0 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:37.638430 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7aa93f09-be8b-4be2-8606-9a3f1a5220e0 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:37.639354 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7aa93f09-be8b-4be2-8606-9a3f1a5220e0 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:37.647366 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7aa93f09-be8b-4be2-8606-9a3f1a5220e0 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:37.654805 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-7aa93f09-be8b-4be2-8606-9a3f1a5220e0 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] HTTP exception thrown: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. May 25 07:37:37.667955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7aa93f09-be8b-4be2-8606-9a3f1a5220e0 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Request method failure captured: May 25 07:37:37.667955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40/os-volume_attachments HTTP/1.1 May 25 07:37:37.667955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:37:37.667955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:37:37.667955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:37:37.667955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:37:37.667955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:37:37.667955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:37:37.667955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:37:37.667955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:37:37.667955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdx8YMUMtTn7uwV83DbQHn749mgpe4pXZQXLuu2Gz2Tiy-xq8T10AKYI3I_0Yu8b0h92jVXFmBePojsxhuNRpYqLdoJahxalfmVmLBpt0Ta0BWIGjuBsX-gmgSdr7G76lKc6TfiFnnslWSR8006uua1lEVurcOiJ36QJJtSPy5RwYf8 May 25 07:37:37.667955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:37:37.667955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:37:37.667955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:37:37.667955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:37:37.667955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:37:37.667955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:37:37.667955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: 39578c81fb5b4b208039318217fdb3a2 May 25 07:37:37.667955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-DeleteServersTestJSON-1468466414 May 25 07:37:37.667955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:37:37.667955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:37:37.669429 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/39578c81fb5b4b208039318217fdb3a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/39578c81fb5b4b208039318217fdb3a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_39578c81fb5b4b208039318217fdb3a2", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/39578c81fb5b4b208039318217fdb3a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:37:37.669429 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-DeleteServersTestJSON-1468466414 May 25 07:37:37.669429 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: 39578c81fb5b4b208039318217fdb3a2 May 25 07:37:37.669429 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-DeleteServersTestJSON-1468466414 May 25 07:37:37.669429 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-DeleteServersTestJSON-1468466414-project May 25 07:37:37.669429 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:37:37.669429 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:37:37.669429 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: 107da1af788341e4817a7038495f050c May 25 07:37:37.669429 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-DeleteServersTestJSON-1468466414-project May 25 07:37:37.669429 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:37:37.669429 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. May 25 07:37:37.669429 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'server_id': '57fedc8c-b769-4f1d-b263-478dcb44da40'} May 25 07:37:37.670339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:37:37.670339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:37.670339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:37:37.670339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:37:37.670339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:37:37.670339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:37:37.670339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:37:37.670339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:37:37.670339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:37:37.670339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:37:37.670339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. May 25 07:37:37.670339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:37.670339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:37.670339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:37.670339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:37.670339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:37:37.670339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:37:37.670339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:37:37.670339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:37:37.670339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:37:37.671673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:37:37.671673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 25 07:37:37.671673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 07:37:37.671673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper May 25 07:37:37.671673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 07:37:37.671673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index May 25 07:37:37.671673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) May 25 07:37:37.671673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:37:37.671673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:37:37.671673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. May 25 07:37:37.671673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:37.671673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:37.671673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:37.671673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:37.671673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:37:37.671673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:37:37.671673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:37:37.671673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:37:37.671673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. May 25 07:37:37.671673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:37.677834 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7aa93f09-be8b-4be2-8606-9a3f1a5220e0 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Returning 404 to user: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:37:37.677834 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-7aa93f09-be8b-4be2-8606-9a3f1a5220e0 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.042836 May 25 07:37:37.677834 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 81/172] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:37:37 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40/os-volume_attachments => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:37:38.273468 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-3aef4fc2-c470-445f-bd85-d9b0e71e5e68 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:38.274369 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-3aef4fc2-c470-445f-bd85-d9b0e71e5e68 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:38.281408 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3aef4fc2-c470-445f-bd85-d9b0e71e5e68 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:38.281953 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3aef4fc2-c470-445f-bd85-d9b0e71e5e68 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:38.282740 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3aef4fc2-c470-445f-bd85-d9b0e71e5e68 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:38.283206 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3aef4fc2-c470-445f-bd85-d9b0e71e5e68 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:38.420763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-3aef4fc2-c470-445f-bd85-d9b0e71e5e68 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:38.425045 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:38.430937 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-3aef4fc2-c470-445f-bd85-d9b0e71e5e68 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.161462 May 25 07:37:38.432006 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 92/173] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:38 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:39.046332 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-dca2ec12-71c6-43ad-a0ae-6ca580b5442a tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:39.047810 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-dca2ec12-71c6-43ad-a0ae-6ca580b5442a tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:39.055136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-dca2ec12-71c6-43ad-a0ae-6ca580b5442a tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:39.055580 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-dca2ec12-71c6-43ad-a0ae-6ca580b5442a tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:39.056348 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-dca2ec12-71c6-43ad-a0ae-6ca580b5442a tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:39.056877 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-dca2ec12-71c6-43ad-a0ae-6ca580b5442a tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:39.074004 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-dca2ec12-71c6-43ad-a0ae-6ca580b5442a tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] HTTP exception thrown: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. May 25 07:37:39.076216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-dca2ec12-71c6-43ad-a0ae-6ca580b5442a tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Request method failure captured: May 25 07:37:39.076216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: DELETE /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 HTTP/1.1 May 25 07:37:39.076216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:37:39.076216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:37:39.076216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:37:39.076216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:37:39.076216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:37:39.076216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:37:39.076216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:37:39.076216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:37:39.076216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdx8YMUMtTn7uwV83DbQHn749mgpe4pXZQXLuu2Gz2Tiy-xq8T10AKYI3I_0Yu8b0h92jVXFmBePojsxhuNRpYqLdoJahxalfmVmLBpt0Ta0BWIGjuBsX-gmgSdr7G76lKc6TfiFnnslWSR8006uua1lEVurcOiJ36QJJtSPy5RwYf8 May 25 07:37:39.076216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:37:39.076216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:37:39.076216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:37:39.076216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:37:39.076216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:37:39.076216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:37:39.076216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: 39578c81fb5b4b208039318217fdb3a2 May 25 07:37:39.076216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-DeleteServersTestJSON-1468466414 May 25 07:37:39.076216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:37:39.076216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:37:39.077741 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/39578c81fb5b4b208039318217fdb3a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/39578c81fb5b4b208039318217fdb3a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_39578c81fb5b4b208039318217fdb3a2", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/39578c81fb5b4b208039318217fdb3a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:37:39.077741 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-DeleteServersTestJSON-1468466414 May 25 07:37:39.077741 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: 39578c81fb5b4b208039318217fdb3a2 May 25 07:37:39.077741 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-DeleteServersTestJSON-1468466414 May 25 07:37:39.077741 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-DeleteServersTestJSON-1468466414-project May 25 07:37:39.077741 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:37:39.077741 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:37:39.077741 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: 107da1af788341e4817a7038495f050c May 25 07:37:39.077741 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-DeleteServersTestJSON-1468466414-project May 25 07:37:39.077741 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:37:39.077741 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. May 25 07:37:39.077741 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': '57fedc8c-b769-4f1d-b263-478dcb44da40'} May 25 07:37:39.078431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:37:39.078431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:39.078431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:37:39.078431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:37:39.078431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:37:39.078431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:37:39.078431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:37:39.078431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:37:39.078431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:37:39.078431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:37:39.078431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. May 25 07:37:39.078431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:39.078431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:39.078431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:39.078431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:39.078431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:37:39.078431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:37:39.078431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:37:39.078431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:37:39.078431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:37:39.079589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:37:39.079589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 07:37:39.079589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 07:37:39.079589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 07:37:39.079589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 07:37:39.079589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:37:39.079589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:37:39.079589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:37:39.079589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:37:39.079589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. May 25 07:37:39.079589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:39.079589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:39.079589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:39.079589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:39.079589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:37:39.079589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:37:39.079589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:37:39.079589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:37:39.079589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. May 25 07:37:39.079589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:39.090149 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-dca2ec12-71c6-43ad-a0ae-6ca580b5442a tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Returning 404 to user: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:37:39.090149 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-dca2ec12-71c6-43ad-a0ae-6ca580b5442a tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "DELETE /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 404 len: 111 microversion: 2.1 time: 0.037582 May 25 07:37:39.090149 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 82/174] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:37:39 2022] DELETE /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:37:39.097658 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8f36b649-984d-4e9d-b2c4-367213936a38 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:39.098441 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-8f36b649-984d-4e9d-b2c4-367213936a38 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] [instance: 57fedc8c-b769-4f1d-b263-478dcb44da40] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:39.113703 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8f36b649-984d-4e9d-b2c4-367213936a38 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:39.114164 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8f36b649-984d-4e9d-b2c4-367213936a38 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:39.124384 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8f36b649-984d-4e9d-b2c4-367213936a38 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:39.124384 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8f36b649-984d-4e9d-b2c4-367213936a38 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:39.131458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-8f36b649-984d-4e9d-b2c4-367213936a38 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] HTTP exception thrown: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. May 25 07:37:39.133031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8f36b649-984d-4e9d-b2c4-367213936a38 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Request method failure captured: May 25 07:37:39.133031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 HTTP/1.1 May 25 07:37:39.133031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:37:39.133031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:37:39.133031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:37:39.133031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:37:39.133031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:37:39.133031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:37:39.133031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:37:39.133031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:37:39.133031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijdx8YMUMtTn7uwV83DbQHn749mgpe4pXZQXLuu2Gz2Tiy-xq8T10AKYI3I_0Yu8b0h92jVXFmBePojsxhuNRpYqLdoJahxalfmVmLBpt0Ta0BWIGjuBsX-gmgSdr7G76lKc6TfiFnnslWSR8006uua1lEVurcOiJ36QJJtSPy5RwYf8 May 25 07:37:39.133031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:37:39.133031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:37:39.133031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:37:39.133031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:37:39.133031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:37:39.133031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:37:39.133031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: 39578c81fb5b4b208039318217fdb3a2 May 25 07:37:39.133031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-DeleteServersTestJSON-1468466414 May 25 07:37:39.133031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:37:39.133031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:37:39.134433 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/39578c81fb5b4b208039318217fdb3a2"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/39578c81fb5b4b208039318217fdb3a2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_39578c81fb5b4b208039318217fdb3a2", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/39578c81fb5b4b208039318217fdb3a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:37:39.134433 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-DeleteServersTestJSON-1468466414 May 25 07:37:39.134433 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: 39578c81fb5b4b208039318217fdb3a2 May 25 07:37:39.134433 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-DeleteServersTestJSON-1468466414 May 25 07:37:39.134433 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-DeleteServersTestJSON-1468466414-project May 25 07:37:39.134433 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:37:39.134433 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:37:39.134433 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: 107da1af788341e4817a7038495f050c May 25 07:37:39.134433 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-DeleteServersTestJSON-1468466414-project May 25 07:37:39.134433 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:37:39.134433 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. May 25 07:37:39.134433 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': '57fedc8c-b769-4f1d-b263-478dcb44da40'} May 25 07:37:39.135096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:37:39.135096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:39.135096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:37:39.135096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:37:39.135096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:37:39.135096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:37:39.135096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:37:39.135096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:37:39.135096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:37:39.135096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:37:39.135096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. May 25 07:37:39.135096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:39.135096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:39.135096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:39.135096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:39.135096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:37:39.135096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:37:39.135096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:37:39.135096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:37:39.135096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:37:39.136543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:37:39.136543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:37:39.136543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:37:39.136543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:37:39.136543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:37:39.136543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:37:39.136543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:37:39.136543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. May 25 07:37:39.136543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:39.136543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:39.136543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:39.136543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:39.136543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:37:39.136543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:37:39.136543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:37:39.136543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:37:39.136543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. May 25 07:37:39.136543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:39.137817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8f36b649-984d-4e9d-b2c4-367213936a38 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] Returning 404 to user: Instance 57fedc8c-b769-4f1d-b263-478dcb44da40 could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:37:39.137817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-8f36b649-984d-4e9d-b2c4-367213936a38 tempest-DeleteServersTestJSON-1468466414 tempest-DeleteServersTestJSON-1468466414-project] 10.222.0.24 "GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40" status: 404 len: 111 microversion: 2.1 time: 0.041622 May 25 07:37:39.137817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 93/175] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:39 2022] GET /compute/v2.1/servers/57fedc8c-b769-4f1d-b263-478dcb44da40 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:37:39.449406 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-cd810399-2452-4101-9cf6-97db7018aead tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:39.450763 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-cd810399-2452-4101-9cf6-97db7018aead tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:39.465139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cd810399-2452-4101-9cf6-97db7018aead tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:39.466370 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cd810399-2452-4101-9cf6-97db7018aead tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:39.467329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cd810399-2452-4101-9cf6-97db7018aead tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:39.467795 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cd810399-2452-4101-9cf6-97db7018aead tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:39.779262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-cd810399-2452-4101-9cf6-97db7018aead tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:39.779262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-cd810399-2452-4101-9cf6-97db7018aead tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.326381 May 25 07:37:39.779262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 83/176] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:39 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:40.788808 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-47df118f-7880-4156-ac9c-dd1c5c35118f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:40.789461 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-47df118f-7880-4156-ac9c-dd1c5c35118f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:40.797056 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-47df118f-7880-4156-ac9c-dd1c5c35118f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:40.797521 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-47df118f-7880-4156-ac9c-dd1c5c35118f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:40.798283 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-47df118f-7880-4156-ac9c-dd1c5c35118f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:40.798722 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-47df118f-7880-4156-ac9c-dd1c5c35118f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:40.935574 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-47df118f-7880-4156-ac9c-dd1c5c35118f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:40.951251 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-47df118f-7880-4156-ac9c-dd1c5c35118f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.166594 May 25 07:37:40.958252 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 94/177] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:40 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:41.970592 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-f8ee7aea-058b-43bb-9c7b-718cd17c5d89 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:41.973938 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-f8ee7aea-058b-43bb-9c7b-718cd17c5d89 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:41.988133 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f8ee7aea-058b-43bb-9c7b-718cd17c5d89 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:41.990914 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f8ee7aea-058b-43bb-9c7b-718cd17c5d89 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:41.992037 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f8ee7aea-058b-43bb-9c7b-718cd17c5d89 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:41.993771 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f8ee7aea-058b-43bb-9c7b-718cd17c5d89 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:42.158161 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-f8ee7aea-058b-43bb-9c7b-718cd17c5d89 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:42.166236 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-f8ee7aea-058b-43bb-9c7b-718cd17c5d89 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.201123 May 25 07:37:42.166865 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 84/178] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:41 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:42.986657 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-1ee48836-7d12-411b-acef-7404800ea550 tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] Action: 'create', calling method: .version_select at 0x7fc86460b790>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-373042839", "metadata": {"Type": "work"}}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:37:43.009245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-1ee48836-7d12-411b-acef-7404800ea550 tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] Request method failure captured: May 25 07:37:43.009245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 25 07:37:43.009245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:37:43.009245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:37:43.009245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:37:43.009245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 121 May 25 07:37:43.009245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:37:43.009245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:37:43.009245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:37:43.009245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:37:43.009245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijdzGdBuGGeryflEraSqXPKi_dFmVl2P-d3eopcmupef0uAJYuWlo6Yy4vTc8310JMAlNPvAY0Vj99EkNc1l0AzsrkDUluu6ySYbwRoqHGwTWH0SZf7s7K1Oy7HWMWwcVtcRvot09g6G6pv1VhtxwjRjmmMv9LuJKJOolYiPEwLypb1E May 25 07:37:43.009245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:37:43.009245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:37:43.009245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:37:43.009245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:37:43.009245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:37:43.009245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:37:43.009245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: ad9af32f663341cfb578c94b572aec04 May 25 07:37:43.009245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-VolumesNegativeTest-1855380296 May 25 07:37:43.009245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:37:43.009245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:37:43.010711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ad9af32f663341cfb578c94b572aec04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ad9af32f663341cfb578c94b572aec04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ad9af32f663341cfb578c94b572aec04", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ad9af32f663341cfb578c94b572aec04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:37:43.010711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-VolumesNegativeTest-1855380296 May 25 07:37:43.010711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: ad9af32f663341cfb578c94b572aec04 May 25 07:37:43.010711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-VolumesNegativeTest-1855380296 May 25 07:37:43.010711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-VolumesNegativeTest-1855380296-project May 25 07:37:43.010711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:37:43.010711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:37:43.010711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: 1238adafe48a433a8710c678c45b2e90 May 25 07:37:43.010711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-VolumesNegativeTest-1855380296-project May 25 07:37:43.010711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: May 25 07:37:43.010711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-373042839", "metadata": {"Type": "work"}}} May 25 07:37:43.010711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: May 25 07:37:43.010711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-373042839', 'metadata': {'Type': 'work'}}}} May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise error May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi On instance['volume']: May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi '#$%' May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:37:43.011807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:37:43.013342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 07:37:43.013342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 07:37:43.013342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:37:43.013342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:37:43.013342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 25 07:37:43.013342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 25 07:37:43.013342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 25 07:37:43.013342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 25 07:37:43.013342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 25 07:37:43.013342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 25 07:37:43.013342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 25 07:37:43.013342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:43.013342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:43.013342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:43.013342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:43.013342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:37:43.013342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:37:43.013342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 25 07:37:43.013342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 25 07:37:43.015523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' May 25 07:37:43.015523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:43.015523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-1ee48836-7d12-411b-acef-7404800ea550 tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:37:43.015523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-1ee48836-7d12-411b-acef-7404800ea550 tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.163743 May 25 07:37:43.015523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 95/179] 10.222.0.24 () {60 vars in 1155 bytes} [Wed May 25 07:37:42 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 167 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 07:37:43.026040 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1ec4a019-3f53-46cf-80a4-6abe40775c18 tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] Action: 'create', calling method: .version_select at 0x7fc864f050d0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1048460978", "metadata": {"Type": "work"}}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:37:43.029308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1ec4a019-3f53-46cf-80a4-6abe40775c18 tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] Request method failure captured: May 25 07:37:43.029308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 25 07:37:43.029308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:37:43.029308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:37:43.029308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:37:43.029308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 120 May 25 07:37:43.029308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:37:43.029308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:37:43.029308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:37:43.029308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:37:43.029308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdzGdBuGGeryflEraSqXPKi_dFmVl2P-d3eopcmupef0uAJYuWlo6Yy4vTc8310JMAlNPvAY0Vj99EkNc1l0AzsrkDUluu6ySYbwRoqHGwTWH0SZf7s7K1Oy7HWMWwcVtcRvot09g6G6pv1VhtxwjRjmmMv9LuJKJOolYiPEwLypb1E May 25 07:37:43.029308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:37:43.029308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:37:43.029308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:37:43.029308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:37:43.029308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:37:43.029308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:37:43.029308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: ad9af32f663341cfb578c94b572aec04 May 25 07:37:43.029308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-VolumesNegativeTest-1855380296 May 25 07:37:43.029308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:37:43.029308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:37:43.030883 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ad9af32f663341cfb578c94b572aec04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ad9af32f663341cfb578c94b572aec04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ad9af32f663341cfb578c94b572aec04", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ad9af32f663341cfb578c94b572aec04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:37:43.030883 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-VolumesNegativeTest-1855380296 May 25 07:37:43.030883 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: ad9af32f663341cfb578c94b572aec04 May 25 07:37:43.030883 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-VolumesNegativeTest-1855380296 May 25 07:37:43.030883 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-VolumesNegativeTest-1855380296-project May 25 07:37:43.030883 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:37:43.030883 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:37:43.030883 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: 1238adafe48a433a8710c678c45b2e90 May 25 07:37:43.030883 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-VolumesNegativeTest-1855380296-project May 25 07:37:43.030883 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: May 25 07:37:43.030883 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1048460978", "metadata": {"Type": "work"}}} May 25 07:37:43.030883 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: May 25 07:37:43.030883 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1048460978', 'metadata': {'Type': 'work'}}}} May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise error May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi On instance['volume']: May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi '0' May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:37:43.031804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:37:43.037368 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 07:37:43.037368 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 07:37:43.037368 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:37:43.037368 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:37:43.037368 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 25 07:37:43.037368 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 25 07:37:43.037368 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 25 07:37:43.037368 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 25 07:37:43.037368 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 25 07:37:43.037368 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 25 07:37:43.037368 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 25 07:37:43.037368 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:43.037368 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:43.037368 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:43.037368 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:43.037368 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:37:43.037368 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:37:43.037368 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 25 07:37:43.037368 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 25 07:37:43.038951 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 May 25 07:37:43.038951 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:43.038951 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1ec4a019-3f53-46cf-80a4-6abe40775c18 tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:37:43.038951 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-1ec4a019-3f53-46cf-80a4-6abe40775c18 tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008801 May 25 07:37:43.038951 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 85/180] 10.222.0.24 () {60 vars in 1155 bytes} [Wed May 25 07:37:43 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 11 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 07:37:43.042111 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-7a773f5b-4280-4443-8663-ff8741fff905 tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] Action: 'create', calling method: .version_select at 0x7fc86446a5e0>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1044953175", "metadata": {"Type": "work"}}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:37:43.044646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-7a773f5b-4280-4443-8663-ff8741fff905 tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] Request method failure captured: May 25 07:37:43.044646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: POST /compute/v2.1/os-volumes HTTP/1.1 May 25 07:37:43.044646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:37:43.044646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:37:43.044646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:37:43.044646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 119 May 25 07:37:43.044646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:37:43.044646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:37:43.044646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:37:43.044646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:37:43.044646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijdzGdBuGGeryflEraSqXPKi_dFmVl2P-d3eopcmupef0uAJYuWlo6Yy4vTc8310JMAlNPvAY0Vj99EkNc1l0AzsrkDUluu6ySYbwRoqHGwTWH0SZf7s7K1Oy7HWMWwcVtcRvot09g6G6pv1VhtxwjRjmmMv9LuJKJOolYiPEwLypb1E May 25 07:37:43.044646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:37:43.044646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:37:43.044646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:37:43.044646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:37:43.044646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:37:43.044646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:37:43.044646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: ad9af32f663341cfb578c94b572aec04 May 25 07:37:43.044646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-VolumesNegativeTest-1855380296 May 25 07:37:43.044646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:37:43.044646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:37:43.046714 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ad9af32f663341cfb578c94b572aec04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ad9af32f663341cfb578c94b572aec04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ad9af32f663341cfb578c94b572aec04", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ad9af32f663341cfb578c94b572aec04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:37:43.046714 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-VolumesNegativeTest-1855380296 May 25 07:37:43.046714 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: ad9af32f663341cfb578c94b572aec04 May 25 07:37:43.046714 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-VolumesNegativeTest-1855380296 May 25 07:37:43.046714 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-VolumesNegativeTest-1855380296-project May 25 07:37:43.046714 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:37:43.046714 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:37:43.046714 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: 1238adafe48a433a8710c678c45b2e90 May 25 07:37:43.046714 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-VolumesNegativeTest-1855380296-project May 25 07:37:43.046714 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: May 25 07:37:43.046714 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1044953175", "metadata": {"Type": "work"}}} May 25 07:37:43.046714 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: May 25 07:37:43.046714 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1044953175', 'metadata': {'Type': 'work'}}}} May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise error May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi On instance['volume']: May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi '' May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:37:43.052599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:37:43.054017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 07:37:43.054017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 07:37:43.054017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:37:43.054017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:37:43.054017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper May 25 07:37:43.054017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], May 25 07:37:43.054017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper May 25 07:37:43.054017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) May 25 07:37:43.054017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate May 25 07:37:43.054017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) May 25 07:37:43.054017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 25 07:37:43.054017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:43.054017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:43.054017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:43.054017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:43.054017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:37:43.054017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:37:43.054017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ May 25 07:37:43.054017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( May 25 07:37:43.055183 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' May 25 07:37:43.055183 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:43.055183 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-7a773f5b-4280-4443-8663-ff8741fff905 tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:37:43.055183 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-7a773f5b-4280-4443-8663-ff8741fff905 tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.008042 May 25 07:37:43.055183 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 96/181] 10.222.0.24 () {60 vars in 1155 bytes} [Wed May 25 07:37:43 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 07:37:43.057012 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-175d406b-d718-4058-afba-a1d9c7b93b8a tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] Calling method '.version_select at 0x7fc8644ad8b0>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:43.087671 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-175d406b-d718-4058-afba-a1d9c7b93b8a tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] HTTP exception thrown: Volume tempest-invalid-886709430 could not be found. May 25 07:37:43.090693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-175d406b-d718-4058-afba-a1d9c7b93b8a tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] Request method failure captured: May 25 07:37:43.090693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-886709430 HTTP/1.1 May 25 07:37:43.090693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:37:43.090693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:37:43.090693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:37:43.090693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:37:43.090693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:37:43.090693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:37:43.090693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:37:43.090693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:37:43.090693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdzGdBuGGeryflEraSqXPKi_dFmVl2P-d3eopcmupef0uAJYuWlo6Yy4vTc8310JMAlNPvAY0Vj99EkNc1l0AzsrkDUluu6ySYbwRoqHGwTWH0SZf7s7K1Oy7HWMWwcVtcRvot09g6G6pv1VhtxwjRjmmMv9LuJKJOolYiPEwLypb1E May 25 07:37:43.090693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:37:43.090693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:37:43.090693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:37:43.090693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:37:43.090693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:37:43.090693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:37:43.090693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: ad9af32f663341cfb578c94b572aec04 May 25 07:37:43.090693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-VolumesNegativeTest-1855380296 May 25 07:37:43.090693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:37:43.090693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:37:43.092162 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ad9af32f663341cfb578c94b572aec04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ad9af32f663341cfb578c94b572aec04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ad9af32f663341cfb578c94b572aec04", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ad9af32f663341cfb578c94b572aec04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:37:43.092162 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-VolumesNegativeTest-1855380296 May 25 07:37:43.092162 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: ad9af32f663341cfb578c94b572aec04 May 25 07:37:43.092162 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-VolumesNegativeTest-1855380296 May 25 07:37:43.092162 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-VolumesNegativeTest-1855380296-project May 25 07:37:43.092162 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:37:43.092162 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:37:43.092162 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: 1238adafe48a433a8710c678c45b2e90 May 25 07:37:43.092162 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-VolumesNegativeTest-1855380296-project May 25 07:37:43.092162 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: May 25 07:37:43.092162 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Volume tempest-invalid-886709430 could not be found. May 25 07:37:43.092162 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': 'tempest-invalid-886709430'} May 25 07:37:43.092162 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:37:43.093010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:43.093010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 07:37:43.093010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 07:37:43.093010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 07:37:43.093010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 07:37:43.093010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 07:37:43.093010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 07:37:43.093010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 07:37:43.093010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 07:37:43.093010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 07:37:43.093010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 07:37:43.093010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 07:37:43.093010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 07:37:43.093010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 07:37:43.093010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 07:37:43.093010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-886709430 could not be found. (HTTP 404) (Request-ID: req-9833b3d1-cd5a-4692-8c75-76d526768cac) May 25 07:37:43.093010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:43.093010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:43.093010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:43.094396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:43.094396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 25 07:37:43.094396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 25 07:37:43.094396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 07:37:43.094396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 07:37:43.094396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 07:37:43.094396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 07:37:43.094396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 07:37:43.094396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 07:37:43.094396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 07:37:43.094396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 07:37:43.094396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 07:37:43.094396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 07:37:43.094396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 07:37:43.094396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 07:37:43.094396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 07:37:43.094396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 07:37:43.094396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 07:37:43.094396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 07:37:43.095670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 07:37:43.095670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 07:37:43.095670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 07:37:43.095670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 07:37:43.095670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-886709430 could not be found. May 25 07:37:43.095670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:43.095670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:43.095670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:43.095670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:43.095670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:37:43.095670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:37:43.095670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:37:43.095670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:37:43.095670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 07:37:43.095670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 07:37:43.095670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:37:43.095670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:37:43.095670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 25 07:37:43.095670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:37:43.095670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-886709430 could not be found. May 25 07:37:43.097020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:43.097020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:43.097020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:43.097020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:43.097020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:37:43.097020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:37:43.097020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:37:43.097020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:37:43.097020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-886709430 could not be found. May 25 07:37:43.097020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:43.097020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-175d406b-d718-4058-afba-a1d9c7b93b8a tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] Returning 404 to user: Volume tempest-invalid-886709430 could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:37:43.097020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-175d406b-d718-4058-afba-a1d9c7b93b8a tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/tempest-invalid-886709430" status: 404 len: 98 microversion: 2.1 time: 0.039283 May 25 07:37:43.097020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 86/182] 10.222.0.24 () {58 vars in 1214 bytes} [Wed May 25 07:37:43 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-886709430 => generated 98 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) May 25 07:37:43.104059 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-0fd696b8-7722-405e-affa-fabb59c2a732 tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004609 May 25 07:37:43.104835 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 97/183] 10.222.0.24 () {58 vars in 1139 bytes} [Wed May 25 07:37:43 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 25 07:37:43.113966 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-088316a4-778a-4858-8868-0c6688ca3377 tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003927 May 25 07:37:43.114456 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 87/184] 10.222.0.24 () {58 vars in 1136 bytes} [Wed May 25 07:37:43 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) May 25 07:37:43.123310 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-d4626b9e-6af0-426e-b890-5662b58b15ff tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] Calling method '.version_select at 0x7fc8644c3dc0>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:43.156850 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-d4626b9e-6af0-426e-b890-5662b58b15ff tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] HTTP exception thrown: Volume 55c5dc27-7a37-45a5-b71a-8c7e74bdd1d8 could not be found. May 25 07:37:43.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-d4626b9e-6af0-426e-b890-5662b58b15ff tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] Request method failure captured: May 25 07:37:43.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: DELETE /compute/v2.1/os-volumes/55c5dc27-7a37-45a5-b71a-8c7e74bdd1d8 HTTP/1.1 May 25 07:37:43.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:37:43.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:37:43.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:37:43.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:37:43.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:37:43.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:37:43.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:37:43.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:37:43.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijdzGdBuGGeryflEraSqXPKi_dFmVl2P-d3eopcmupef0uAJYuWlo6Yy4vTc8310JMAlNPvAY0Vj99EkNc1l0AzsrkDUluu6ySYbwRoqHGwTWH0SZf7s7K1Oy7HWMWwcVtcRvot09g6G6pv1VhtxwjRjmmMv9LuJKJOolYiPEwLypb1E May 25 07:37:43.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:37:43.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:37:43.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:37:43.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:37:43.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:37:43.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:37:43.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: ad9af32f663341cfb578c94b572aec04 May 25 07:37:43.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-VolumesNegativeTest-1855380296 May 25 07:37:43.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:37:43.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:37:43.161291 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ad9af32f663341cfb578c94b572aec04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ad9af32f663341cfb578c94b572aec04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ad9af32f663341cfb578c94b572aec04", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ad9af32f663341cfb578c94b572aec04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:37:43.161291 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-VolumesNegativeTest-1855380296 May 25 07:37:43.161291 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: ad9af32f663341cfb578c94b572aec04 May 25 07:37:43.161291 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-VolumesNegativeTest-1855380296 May 25 07:37:43.161291 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-VolumesNegativeTest-1855380296-project May 25 07:37:43.161291 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:37:43.161291 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:37:43.161291 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: 1238adafe48a433a8710c678c45b2e90 May 25 07:37:43.161291 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-VolumesNegativeTest-1855380296-project May 25 07:37:43.161291 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: May 25 07:37:43.161291 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Volume 55c5dc27-7a37-45a5-b71a-8c7e74bdd1d8 could not be found. May 25 07:37:43.161291 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': '55c5dc27-7a37-45a5-b71a-8c7e74bdd1d8'} May 25 07:37:43.161291 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:37:43.162144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:43.162144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 07:37:43.162144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 07:37:43.162144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 07:37:43.162144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 07:37:43.162144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 07:37:43.162144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 07:37:43.162144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 07:37:43.162144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 07:37:43.162144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 07:37:43.162144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 07:37:43.162144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 07:37:43.162144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 07:37:43.162144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 07:37:43.162144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 07:37:43.162144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 55c5dc27-7a37-45a5-b71a-8c7e74bdd1d8 could not be found. (HTTP 404) (Request-ID: req-afdcc4a7-94ba-476a-b3c7-e34460cac810) May 25 07:37:43.162144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:43.162144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:43.162144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:43.163662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:43.163662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete May 25 07:37:43.163662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) May 25 07:37:43.163662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 07:37:43.163662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 07:37:43.163662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 07:37:43.163662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 07:37:43.163662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 07:37:43.163662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 07:37:43.163662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 07:37:43.163662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 07:37:43.163662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete May 25 07:37:43.163662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) May 25 07:37:43.163662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete May 25 07:37:43.163662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return self._delete(loc) May 25 07:37:43.163662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete May 25 07:37:43.163662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) May 25 07:37:43.163662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete May 25 07:37:43.163662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) May 25 07:37:43.164871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 07:37:43.164871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 07:37:43.164871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 07:37:43.164871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 07:37:43.164871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 55c5dc27-7a37-45a5-b71a-8c7e74bdd1d8 could not be found. May 25 07:37:43.164871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:43.164871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:43.164871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:43.164871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:43.164871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:37:43.164871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:37:43.164871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:37:43.164871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:37:43.164871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 07:37:43.164871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 07:37:43.164871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:37:43.164871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:37:43.164871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete May 25 07:37:43.164871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:37:43.166012 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 55c5dc27-7a37-45a5-b71a-8c7e74bdd1d8 could not be found. May 25 07:37:43.166012 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:43.166012 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:43.166012 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:43.166012 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:43.166012 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:37:43.166012 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:37:43.166012 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:37:43.166012 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:37:43.166012 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 55c5dc27-7a37-45a5-b71a-8c7e74bdd1d8 could not be found. May 25 07:37:43.166012 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:37:43.166012 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-d4626b9e-6af0-426e-b890-5662b58b15ff tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] Returning 404 to user: Volume 55c5dc27-7a37-45a5-b71a-8c7e74bdd1d8 could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:37:43.166012 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-d4626b9e-6af0-426e-b890-5662b58b15ff tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/55c5dc27-7a37-45a5-b71a-8c7e74bdd1d8" status: 404 len: 109 microversion: 2.1 time: 0.041858 May 25 07:37:43.167559 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 98/185] 10.222.0.24 () {58 vars in 1247 bytes} [Wed May 25 07:37:43 2022] DELETE /compute/v2.1/os-volumes/55c5dc27-7a37-45a5-b71a-8c7e74bdd1d8 => generated 109 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:37:43.173742 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-2931231b-b83d-4016-bfb6-d86046c548ac tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] Calling method '.version_select at 0x7fc8644f19d0>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:43.183516 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-6d82aa3a-d497-4af4-9cd0-9484f75eeba0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:43.184277 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-6d82aa3a-d497-4af4-9cd0-9484f75eeba0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:43.193119 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6d82aa3a-d497-4af4-9cd0-9484f75eeba0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:43.193584 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6d82aa3a-d497-4af4-9cd0-9484f75eeba0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:43.194370 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6d82aa3a-d497-4af4-9cd0-9484f75eeba0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:43.194820 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6d82aa3a-d497-4af4-9cd0-9484f75eeba0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:43.203852 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-2931231b-b83d-4016-bfb6-d86046c548ac tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] HTTP exception thrown: Volume 3030c9f7-5c08-4427-917e-564a41d6400f could not be found. May 25 07:37:43.205851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-2931231b-b83d-4016-bfb6-d86046c548ac tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] Request method failure captured: May 25 07:37:43.205851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: GET /compute/v2.1/os-volumes/3030c9f7-5c08-4427-917e-564a41d6400f HTTP/1.1 May 25 07:37:43.205851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:37:43.205851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:37:43.205851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:37:43.205851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:37:43.205851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:37:43.205851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:37:43.205851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:37:43.205851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:37:43.205851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdzGdBuGGeryflEraSqXPKi_dFmVl2P-d3eopcmupef0uAJYuWlo6Yy4vTc8310JMAlNPvAY0Vj99EkNc1l0AzsrkDUluu6ySYbwRoqHGwTWH0SZf7s7K1Oy7HWMWwcVtcRvot09g6G6pv1VhtxwjRjmmMv9LuJKJOolYiPEwLypb1E May 25 07:37:43.205851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:37:43.205851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:37:43.205851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:37:43.205851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:37:43.205851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:37:43.205851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:37:43.205851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: ad9af32f663341cfb578c94b572aec04 May 25 07:37:43.205851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-VolumesNegativeTest-1855380296 May 25 07:37:43.205851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:37:43.205851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:37:43.207308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ad9af32f663341cfb578c94b572aec04"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ad9af32f663341cfb578c94b572aec04"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ad9af32f663341cfb578c94b572aec04", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ad9af32f663341cfb578c94b572aec04"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:37:43.207308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-VolumesNegativeTest-1855380296 May 25 07:37:43.207308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: ad9af32f663341cfb578c94b572aec04 May 25 07:37:43.207308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-VolumesNegativeTest-1855380296 May 25 07:37:43.207308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-VolumesNegativeTest-1855380296-project May 25 07:37:43.207308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:37:43.207308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:37:43.207308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: 1238adafe48a433a8710c678c45b2e90 May 25 07:37:43.207308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-VolumesNegativeTest-1855380296-project May 25 07:37:43.207308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: May 25 07:37:43.207308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Volume 3030c9f7-5c08-4427-917e-564a41d6400f could not be found. May 25 07:37:43.207308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': '3030c9f7-5c08-4427-917e-564a41d6400f'} May 25 07:37:43.207308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:37:43.208110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:43.208110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 07:37:43.208110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 07:37:43.208110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 07:37:43.208110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 07:37:43.208110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 07:37:43.208110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 07:37:43.208110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 07:37:43.208110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 07:37:43.208110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 07:37:43.208110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 07:37:43.208110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 07:37:43.208110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 07:37:43.208110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 07:37:43.208110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 07:37:43.208110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3030c9f7-5c08-4427-917e-564a41d6400f could not be found. (HTTP 404) (Request-ID: req-00ac2e2d-49ed-4330-99d4-01b7898f8229) May 25 07:37:43.208110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:43.208110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:43.208110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:43.209500 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:43.209500 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 07:37:43.209500 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 07:37:43.209500 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 07:37:43.209500 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 07:37:43.209500 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 07:37:43.209500 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 07:37:43.209500 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 07:37:43.209500 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 07:37:43.209500 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 07:37:43.209500 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 07:37:43.209500 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 07:37:43.209500 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 07:37:43.209500 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 07:37:43.209500 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 07:37:43.209500 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 07:37:43.209500 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 07:37:43.209500 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 07:37:43.209500 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 07:37:43.212041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 07:37:43.212041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 07:37:43.212041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 07:37:43.212041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 07:37:43.212041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3030c9f7-5c08-4427-917e-564a41d6400f could not be found. May 25 07:37:43.212041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:43.212041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:43.212041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:43.212041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:43.212041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:37:43.212041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:37:43.212041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:37:43.212041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:37:43.212041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 07:37:43.212041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 07:37:43.212041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:37:43.212041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:37:43.212041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 07:37:43.212041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:37:43.214104 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3030c9f7-5c08-4427-917e-564a41d6400f could not be found. May 25 07:37:43.214104 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:43.214104 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:37:43.214104 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:43.214104 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:37:43.214104 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:37:43.214104 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:37:43.214104 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:37:43.214104 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:37:43.214104 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3030c9f7-5c08-4427-917e-564a41d6400f could not be found. May 25 07:37:43.214104 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:37:43.214104 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-2931231b-b83d-4016-bfb6-d86046c548ac tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] Returning 404 to user: Volume 3030c9f7-5c08-4427-917e-564a41d6400f could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:37:43.214104 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-2931231b-b83d-4016-bfb6-d86046c548ac tempest-VolumesNegativeTest-1855380296 tempest-VolumesNegativeTest-1855380296-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/3030c9f7-5c08-4427-917e-564a41d6400f" status: 404 len: 109 microversion: 2.1 time: 0.038122 May 25 07:37:43.214104 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 88/186] 10.222.0.24 () {58 vars in 1244 bytes} [Wed May 25 07:37:43 2022] GET /compute/v2.1/os-volumes/3030c9f7-5c08-4427-917e-564a41d6400f => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:37:43.340931 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-6d82aa3a-d497-4af4-9cd0-9484f75eeba0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:43.349440 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-6d82aa3a-d497-4af4-9cd0-9484f75eeba0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.170038 May 25 07:37:43.354082 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 99/187] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:43 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:37:44.370128 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-076cb579-820e-4197-889c-b95bae1a3d08 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:44.371229 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-076cb579-820e-4197-889c-b95bae1a3d08 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:44.381251 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-076cb579-820e-4197-889c-b95bae1a3d08 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:44.381699 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-076cb579-820e-4197-889c-b95bae1a3d08 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:44.382563 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-076cb579-820e-4197-889c-b95bae1a3d08 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:44.383024 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-076cb579-820e-4197-889c-b95bae1a3d08 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:44.524225 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-076cb579-820e-4197-889c-b95bae1a3d08 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:44.532239 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-076cb579-820e-4197-889c-b95bae1a3d08 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.166220 May 25 07:37:44.532858 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 89/188] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:44 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:45.550197 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-90021f38-774f-4cfc-bec4-cf7e11ab6f8e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:45.550882 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-90021f38-774f-4cfc-bec4-cf7e11ab6f8e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:45.557214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-90021f38-774f-4cfc-bec4-cf7e11ab6f8e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:45.557676 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-90021f38-774f-4cfc-bec4-cf7e11ab6f8e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:45.558443 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-90021f38-774f-4cfc-bec4-cf7e11ab6f8e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:45.558887 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-90021f38-774f-4cfc-bec4-cf7e11ab6f8e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:45.925356 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-90021f38-774f-4cfc-bec4-cf7e11ab6f8e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:45.932904 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-90021f38-774f-4cfc-bec4-cf7e11ab6f8e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.387353 May 25 07:37:45.933464 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 100/189] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:45 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:46.950328 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-13b4bb11-d754-42eb-b5c1-4209bcf9094e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:46.950938 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-13b4bb11-d754-42eb-b5c1-4209bcf9094e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:46.957124 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-13b4bb11-d754-42eb-b5c1-4209bcf9094e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:46.957577 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-13b4bb11-d754-42eb-b5c1-4209bcf9094e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:46.958350 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-13b4bb11-d754-42eb-b5c1-4209bcf9094e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:46.958788 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-13b4bb11-d754-42eb-b5c1-4209bcf9094e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:47.084883 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-13b4bb11-d754-42eb-b5c1-4209bcf9094e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:47.100451 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-13b4bb11-d754-42eb-b5c1-4209bcf9094e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.146051 May 25 07:37:47.100451 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 90/190] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:46 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:37:48.109805 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-f52bf7cc-196f-4ce0-aa33-0f5cc3bd0cc0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:48.110420 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-f52bf7cc-196f-4ce0-aa33-0f5cc3bd0cc0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:48.117148 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f52bf7cc-196f-4ce0-aa33-0f5cc3bd0cc0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:48.117639 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f52bf7cc-196f-4ce0-aa33-0f5cc3bd0cc0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:48.118408 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f52bf7cc-196f-4ce0-aa33-0f5cc3bd0cc0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:48.118852 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f52bf7cc-196f-4ce0-aa33-0f5cc3bd0cc0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:48.252651 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-f52bf7cc-196f-4ce0-aa33-0f5cc3bd0cc0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:48.260237 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-f52bf7cc-196f-4ce0-aa33-0f5cc3bd0cc0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.154322 May 25 07:37:48.261011 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 101/191] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:48 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:49.282933 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-3726c637-660f-44b0-858c-91b8a61881ca tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:49.283845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-3726c637-660f-44b0-858c-91b8a61881ca tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:49.290459 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3726c637-660f-44b0-858c-91b8a61881ca tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:49.291251 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3726c637-660f-44b0-858c-91b8a61881ca tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:49.292203 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3726c637-660f-44b0-858c-91b8a61881ca tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:49.292692 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3726c637-660f-44b0-858c-91b8a61881ca tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:49.483658 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-3726c637-660f-44b0-858c-91b8a61881ca tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:49.491601 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-3726c637-660f-44b0-858c-91b8a61881ca tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.213583 May 25 07:37:49.492214 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 91/192] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:49 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:50.508990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-337bce35-523f-4fb3-a046-4611d0a1e41e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:50.509675 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-337bce35-523f-4fb3-a046-4611d0a1e41e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:50.517458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-337bce35-523f-4fb3-a046-4611d0a1e41e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:50.517930 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-337bce35-523f-4fb3-a046-4611d0a1e41e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:50.518767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-337bce35-523f-4fb3-a046-4611d0a1e41e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:50.519192 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-337bce35-523f-4fb3-a046-4611d0a1e41e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:50.662167 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-337bce35-523f-4fb3-a046-4611d0a1e41e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:50.669816 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-337bce35-523f-4fb3-a046-4611d0a1e41e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.164625 May 25 07:37:50.670384 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 102/193] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:50 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:51.686870 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d2d69772-0ce9-4695-947b-bf27f00f35e5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:51.687625 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d2d69772-0ce9-4695-947b-bf27f00f35e5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:51.693693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d2d69772-0ce9-4695-947b-bf27f00f35e5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:51.694341 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d2d69772-0ce9-4695-947b-bf27f00f35e5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:51.695190 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d2d69772-0ce9-4695-947b-bf27f00f35e5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:51.695688 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d2d69772-0ce9-4695-947b-bf27f00f35e5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:51.823707 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d2d69772-0ce9-4695-947b-bf27f00f35e5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:51.832056 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d2d69772-0ce9-4695-947b-bf27f00f35e5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.148900 May 25 07:37:51.832657 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 92/194] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:51 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:52.849963 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-d7f628c2-ab6f-490e-8a3c-425c36638e09 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:52.850815 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-d7f628c2-ab6f-490e-8a3c-425c36638e09 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:52.854133 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:52.859968 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d7f628c2-ab6f-490e-8a3c-425c36638e09 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:52.860423 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d7f628c2-ab6f-490e-8a3c-425c36638e09 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:52.861221 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d7f628c2-ab6f-490e-8a3c-425c36638e09 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:52.861666 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d7f628c2-ab6f-490e-8a3c-425c36638e09 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:53.003369 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d7f628c2-ab6f-490e-8a3c-425c36638e09 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:53.010748 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-d7f628c2-ab6f-490e-8a3c-425c36638e09 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.165207 May 25 07:37:53.011304 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 103/195] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:52 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:54.028732 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-f73b85c7-2bd5-44d2-b073-d18e2b36679e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:54.029347 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-f73b85c7-2bd5-44d2-b073-d18e2b36679e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:54.031477 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=64 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:37:54.036305 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f73b85c7-2bd5-44d2-b073-d18e2b36679e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:54.036786 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f73b85c7-2bd5-44d2-b073-d18e2b36679e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:54.037555 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f73b85c7-2bd5-44d2-b073-d18e2b36679e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:54.037992 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f73b85c7-2bd5-44d2-b073-d18e2b36679e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:54.175730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-f73b85c7-2bd5-44d2-b073-d18e2b36679e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:54.183125 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-f73b85c7-2bd5-44d2-b073-d18e2b36679e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.158378 May 25 07:37:54.183690 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 93/196] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:54 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:55.201137 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-0c8b3908-3153-4ccc-a7db-fc64b75056db tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:55.201784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-0c8b3908-3153-4ccc-a7db-fc64b75056db tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:55.209203 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0c8b3908-3153-4ccc-a7db-fc64b75056db tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:55.209670 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0c8b3908-3153-4ccc-a7db-fc64b75056db tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:55.210425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0c8b3908-3153-4ccc-a7db-fc64b75056db tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:55.210867 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0c8b3908-3153-4ccc-a7db-fc64b75056db tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:55.344828 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-0c8b3908-3153-4ccc-a7db-fc64b75056db tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:55.352364 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-0c8b3908-3153-4ccc-a7db-fc64b75056db tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1519 microversion: 2.1 time: 0.155185 May 25 07:37:55.352958 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 104/197] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:55 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:37:56.369742 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-b4c5d290-ccb0-4f4d-a9ed-3b37127d1dfc tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:56.370419 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-b4c5d290-ccb0-4f4d-a9ed-3b37127d1dfc tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:56.377397 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b4c5d290-ccb0-4f4d-a9ed-3b37127d1dfc tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:56.377839 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b4c5d290-ccb0-4f4d-a9ed-3b37127d1dfc tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:56.378623 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b4c5d290-ccb0-4f4d-a9ed-3b37127d1dfc tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:56.379067 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b4c5d290-ccb0-4f4d-a9ed-3b37127d1dfc tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:56.511051 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-b4c5d290-ccb0-4f4d-a9ed-3b37127d1dfc tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:56.519950 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-b4c5d290-ccb0-4f4d-a9ed-3b37127d1dfc tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1499 microversion: 2.1 time: 0.154559 May 25 07:37:56.520557 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 94/198] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:56 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1499 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:37:56.536347 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-5e6f7c99-b960-462a-8986-cc06c242e4e0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:37:56.537141 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-5e6f7c99-b960-462a-8986-cc06c242e4e0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:37:56.544124 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5e6f7c99-b960-462a-8986-cc06c242e4e0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:56.548638 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5e6f7c99-b960-462a-8986-cc06c242e4e0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:56.548638 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5e6f7c99-b960-462a-8986-cc06c242e4e0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:37:56.548638 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5e6f7c99-b960-462a-8986-cc06c242e4e0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:37:56.690685 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-5e6f7c99-b960-462a-8986-cc06c242e4e0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:37:56.698816 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-5e6f7c99-b960-462a-8986-cc06c242e4e0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1512 microversion: 2.1 time: 0.166707 May 25 07:37:56.699402 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 105/199] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:37:56 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1512 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:00.880769 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-31fe5fdd-17fc-4c95-b4a4-14f1c6a7edad tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:38:00.882110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-31fe5fdd-17fc-4c95-b4a4-14f1c6a7edad tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:00.888387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-31fe5fdd-17fc-4c95-b4a4-14f1c6a7edad tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:00.888867 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-31fe5fdd-17fc-4c95-b4a4-14f1c6a7edad tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:00.894133 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-31fe5fdd-17fc-4c95-b4a4-14f1c6a7edad tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:00.894133 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-31fe5fdd-17fc-4c95-b4a4-14f1c6a7edad tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:00.913243 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.objects.instance [None req-31fe5fdd-17fc-4c95-b4a4-14f1c6a7edad tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lazy-loading 'flavor' on Instance uuid 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 {{(pid=124674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:38:01.244265 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-31fe5fdd-17fc-4c95-b4a4-14f1c6a7edad tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "POST /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2/action" status: 200 len: 32 microversion: 2.1 time: 0.367585 May 25 07:38:01.244912 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 95/200] 10.222.0.24 () {60 vars in 1277 bytes} [Wed May 25 07:38:00 2022] POST /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2/action => generated 32 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 25 07:38:01.254747 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-fd770ed6-ecf1-4c8f-ae9e-9cac25144fdb tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:01.255500 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-fd770ed6-ecf1-4c8f-ae9e-9cac25144fdb tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:01.262227 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fd770ed6-ecf1-4c8f-ae9e-9cac25144fdb tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:01.262679 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fd770ed6-ecf1-4c8f-ae9e-9cac25144fdb tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:01.263454 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fd770ed6-ecf1-4c8f-ae9e-9cac25144fdb tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:01.263887 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fd770ed6-ecf1-4c8f-ae9e-9cac25144fdb tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:01.403947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-fd770ed6-ecf1-4c8f-ae9e-9cac25144fdb tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:01.412964 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-fd770ed6-ecf1-4c8f-ae9e-9cac25144fdb tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1518 microversion: 2.1 time: 0.161981 May 25 07:38:01.413612 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 106/201] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:01 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:02.434290 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-df3406ef-61e3-4721-873e-446106a978cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:02.434290 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-df3406ef-61e3-4721-873e-446106a978cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:02.442278 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-df3406ef-61e3-4721-873e-446106a978cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:02.442752 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-df3406ef-61e3-4721-873e-446106a978cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:02.443682 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-df3406ef-61e3-4721-873e-446106a978cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:02.444253 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-df3406ef-61e3-4721-873e-446106a978cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:02.459873 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:02.598786 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-df3406ef-61e3-4721-873e-446106a978cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:02.607251 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-df3406ef-61e3-4721-873e-446106a978cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1518 microversion: 2.1 time: 0.179973 May 25 07:38:02.607911 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 96/202] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:02 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1518 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:03.626038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-2d00d037-5b25-4460-8f60-d7656420fb54 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:03.626729 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-2d00d037-5b25-4460-8f60-d7656420fb54 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:03.633620 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2d00d037-5b25-4460-8f60-d7656420fb54 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:03.634089 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2d00d037-5b25-4460-8f60-d7656420fb54 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:03.634854 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2d00d037-5b25-4460-8f60-d7656420fb54 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:03.635288 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2d00d037-5b25-4460-8f60-d7656420fb54 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:03.771393 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-2d00d037-5b25-4460-8f60-d7656420fb54 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:03.779342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-2d00d037-5b25-4460-8f60-d7656420fb54 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1518 microversion: 2.1 time: 0.158152 May 25 07:38:03.779943 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 107/203] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:03 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:04.797804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-0cc0585a-194b-4efd-b83a-1daef1288ba7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:04.798513 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-0cc0585a-194b-4efd-b83a-1daef1288ba7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:04.805083 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0cc0585a-194b-4efd-b83a-1daef1288ba7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:04.805565 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0cc0585a-194b-4efd-b83a-1daef1288ba7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:04.806292 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0cc0585a-194b-4efd-b83a-1daef1288ba7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:04.806724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0cc0585a-194b-4efd-b83a-1daef1288ba7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:04.935967 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-0cc0585a-194b-4efd-b83a-1daef1288ba7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:04.945247 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-0cc0585a-194b-4efd-b83a-1daef1288ba7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1518 microversion: 2.1 time: 0.151879 May 25 07:38:04.945918 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 97/204] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:04 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1518 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:05.963307 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-53894750-f372-46e5-b336-921b2cfc1a76 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:05.963961 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-53894750-f372-46e5-b336-921b2cfc1a76 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:05.972151 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-53894750-f372-46e5-b336-921b2cfc1a76 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:05.973866 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-53894750-f372-46e5-b336-921b2cfc1a76 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:05.973866 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-53894750-f372-46e5-b336-921b2cfc1a76 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:05.974403 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-53894750-f372-46e5-b336-921b2cfc1a76 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:06.111013 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-53894750-f372-46e5-b336-921b2cfc1a76 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:06.118763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-53894750-f372-46e5-b336-921b2cfc1a76 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1518 microversion: 2.1 time: 0.159549 May 25 07:38:06.119524 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 108/205] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:05 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:07.136662 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-fcbf2238-17b9-4b46-8f41-e6da38c1470c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:07.137180 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-fcbf2238-17b9-4b46-8f41-e6da38c1470c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:07.143844 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fcbf2238-17b9-4b46-8f41-e6da38c1470c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:07.144287 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fcbf2238-17b9-4b46-8f41-e6da38c1470c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:07.145069 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fcbf2238-17b9-4b46-8f41-e6da38c1470c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:07.145502 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fcbf2238-17b9-4b46-8f41-e6da38c1470c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:07.280658 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-fcbf2238-17b9-4b46-8f41-e6da38c1470c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:07.283270 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-fcbf2238-17b9-4b46-8f41-e6da38c1470c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1518 microversion: 2.1 time: 0.150591 May 25 07:38:07.283846 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 98/206] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:07 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1518 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:08.300345 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-58bec92c-946d-4b02-9804-0359a83823f8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:08.301000 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-58bec92c-946d-4b02-9804-0359a83823f8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:08.307631 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-58bec92c-946d-4b02-9804-0359a83823f8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:08.308093 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-58bec92c-946d-4b02-9804-0359a83823f8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:08.308906 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-58bec92c-946d-4b02-9804-0359a83823f8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:08.310882 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-58bec92c-946d-4b02-9804-0359a83823f8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:08.447316 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-58bec92c-946d-4b02-9804-0359a83823f8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:08.455712 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-58bec92c-946d-4b02-9804-0359a83823f8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1518 microversion: 2.1 time: 0.159892 May 25 07:38:08.460646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 109/207] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:08 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1518 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:09.476495 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c9e09a10-dc14-4a56-bcd7-a643286e3982 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:09.477150 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c9e09a10-dc14-4a56-bcd7-a643286e3982 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:09.483398 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c9e09a10-dc14-4a56-bcd7-a643286e3982 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:09.484418 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c9e09a10-dc14-4a56-bcd7-a643286e3982 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:09.485281 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c9e09a10-dc14-4a56-bcd7-a643286e3982 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:09.485719 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c9e09a10-dc14-4a56-bcd7-a643286e3982 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:09.628106 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c9e09a10-dc14-4a56-bcd7-a643286e3982 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:09.635660 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c9e09a10-dc14-4a56-bcd7-a643286e3982 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1518 microversion: 2.1 time: 0.162987 May 25 07:38:09.636225 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 99/208] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:09 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1518 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:10.654181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-dd99f5d7-f558-4ad0-8776-f10ef69dcc55 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:10.654914 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-dd99f5d7-f558-4ad0-8776-f10ef69dcc55 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:10.662490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dd99f5d7-f558-4ad0-8776-f10ef69dcc55 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:10.663006 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dd99f5d7-f558-4ad0-8776-f10ef69dcc55 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:10.663698 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dd99f5d7-f558-4ad0-8776-f10ef69dcc55 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:10.664132 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dd99f5d7-f558-4ad0-8776-f10ef69dcc55 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:10.814365 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-dd99f5d7-f558-4ad0-8776-f10ef69dcc55 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:10.826609 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-dd99f5d7-f558-4ad0-8776-f10ef69dcc55 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1518 microversion: 2.1 time: 0.173977 May 25 07:38:10.826609 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 110/209] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:10 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:11.843182 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-5740a194-4345-406f-84d0-15477fbe7765 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:11.843819 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-5740a194-4345-406f-84d0-15477fbe7765 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:11.850071 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5740a194-4345-406f-84d0-15477fbe7765 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:11.850514 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5740a194-4345-406f-84d0-15477fbe7765 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:11.851301 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5740a194-4345-406f-84d0-15477fbe7765 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:11.851719 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5740a194-4345-406f-84d0-15477fbe7765 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:11.997552 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-5740a194-4345-406f-84d0-15477fbe7765 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:12.013059 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-5740a194-4345-406f-84d0-15477fbe7765 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1518 microversion: 2.1 time: 0.172820 May 25 07:38:12.013059 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 100/210] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:11 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1518 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:13.032622 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-7fe8fb56-f7c6-4139-a191-f1f3d09da86e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:13.034866 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-7fe8fb56-f7c6-4139-a191-f1f3d09da86e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:13.042653 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7fe8fb56-f7c6-4139-a191-f1f3d09da86e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:13.043262 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7fe8fb56-f7c6-4139-a191-f1f3d09da86e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:13.044200 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7fe8fb56-f7c6-4139-a191-f1f3d09da86e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:13.044715 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7fe8fb56-f7c6-4139-a191-f1f3d09da86e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:13.056318 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=81 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:13.189954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-7fe8fb56-f7c6-4139-a191-f1f3d09da86e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:13.197710 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-7fe8fb56-f7c6-4139-a191-f1f3d09da86e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1518 microversion: 2.1 time: 0.169044 May 25 07:38:13.198285 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 111/211] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:13 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1518 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:14.214970 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-391c4257-11ce-48f8-be4c-470b584e3dbd tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:14.217360 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-391c4257-11ce-48f8-be4c-470b584e3dbd tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:14.223750 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-391c4257-11ce-48f8-be4c-470b584e3dbd tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:14.223750 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-391c4257-11ce-48f8-be4c-470b584e3dbd tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:14.224516 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-391c4257-11ce-48f8-be4c-470b584e3dbd tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:14.225271 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-391c4257-11ce-48f8-be4c-470b584e3dbd tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:14.359328 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-391c4257-11ce-48f8-be4c-470b584e3dbd tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:14.367719 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-391c4257-11ce-48f8-be4c-470b584e3dbd tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1518 microversion: 2.1 time: 0.156476 May 25 07:38:14.368645 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 101/212] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:14 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:15.385895 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-3e580b59-9adc-4669-9e06-f0bfe9314ba4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:15.386990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-3e580b59-9adc-4669-9e06-f0bfe9314ba4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:15.394514 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3e580b59-9adc-4669-9e06-f0bfe9314ba4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:15.394982 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3e580b59-9adc-4669-9e06-f0bfe9314ba4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:15.396142 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3e580b59-9adc-4669-9e06-f0bfe9314ba4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:15.396804 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3e580b59-9adc-4669-9e06-f0bfe9314ba4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:15.551219 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-3e580b59-9adc-4669-9e06-f0bfe9314ba4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:15.560976 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-3e580b59-9adc-4669-9e06-f0bfe9314ba4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1518 microversion: 2.1 time: 0.179858 May 25 07:38:15.562465 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 112/213] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:15 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1518 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:16.581649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d18aea95-ef53-4acb-8a8d-22e42f5b48ce tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:16.588192 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d18aea95-ef53-4acb-8a8d-22e42f5b48ce tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:16.600418 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d18aea95-ef53-4acb-8a8d-22e42f5b48ce tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:16.600915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d18aea95-ef53-4acb-8a8d-22e42f5b48ce tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:16.601702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d18aea95-ef53-4acb-8a8d-22e42f5b48ce tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:16.602193 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d18aea95-ef53-4acb-8a8d-22e42f5b48ce tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:16.736484 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d18aea95-ef53-4acb-8a8d-22e42f5b48ce tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:16.744556 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d18aea95-ef53-4acb-8a8d-22e42f5b48ce tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1498 microversion: 2.1 time: 0.168092 May 25 07:38:16.745131 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 102/214] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:16 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1498 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:16.763359 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-6293d81c-4705-42c4-9c3f-387d1e14dfd6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0ab957c0-daa8-4f19-bfbf-0159668d08d7"}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:38:16.764427 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-6293d81c-4705-42c4-9c3f-387d1e14dfd6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:16.771731 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6293d81c-4705-42c4-9c3f-387d1e14dfd6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:16.772185 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6293d81c-4705-42c4-9c3f-387d1e14dfd6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:16.772988 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6293d81c-4705-42c4-9c3f-387d1e14dfd6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:16.773425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6293d81c-4705-42c4-9c3f-387d1e14dfd6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:16.798752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-6293d81c-4705-42c4-9c3f-387d1e14dfd6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] HTTP exception thrown: Cannot 'attach_volume' instance 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 while it is in vm_state rescued May 25 07:38:16.801397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-6293d81c-4705-42c4-9c3f-387d1e14dfd6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Request method failure captured: May 25 07:38:16.801397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: POST /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2/os-volume_attachments HTTP/1.1 May 25 07:38:16.801397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:38:16.801397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:38:16.801397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:38:16.801397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 74 May 25 07:38:16.801397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:38:16.801397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:38:16.801397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:38:16.801397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:38:16.801397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijdyGuqDe3p06hkpp6ohyIkCZkEMZD-Xm9k8dFGeecHnJxdqekCaABg8wzmfOAlxn-W8UpasXr7XYWqwQfoR7IZRkPp3JQjBoqqqadXk1ODtfCJewTnu7WrLyB1br2CZbFtQzX_dfu8qpnIIdjcBpxB5N_NNozK67UOqIu_ddo6FZg-U May 25 07:38:16.801397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:38:16.801397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:38:16.801397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:38:16.801397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:38:16.801397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:38:16.801397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:38:16.801397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: d4719a4804e24f27b9427e58c5cbe13b May 25 07:38:16.801397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-274124411 May 25 07:38:16.801397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:38:16.801397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:38:16.802873 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d4719a4804e24f27b9427e58c5cbe13b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/d4719a4804e24f27b9427e58c5cbe13b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_d4719a4804e24f27b9427e58c5cbe13b", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d4719a4804e24f27b9427e58c5cbe13b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:38:16.802873 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-ServerRescueNegativeTestJSON-274124411 May 25 07:38:16.802873 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: d4719a4804e24f27b9427e58c5cbe13b May 25 07:38:16.802873 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-274124411 May 25 07:38:16.802873 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-ServerRescueNegativeTestJSON-274124411-project May 25 07:38:16.802873 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:38:16.802873 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:38:16.802873 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: f90f0f6afda54e80bc319dc5bdb80ea6 May 25 07:38:16.802873 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-ServerRescueNegativeTestJSON-274124411-project May 25 07:38:16.802873 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: May 25 07:38:16.802873 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {"volumeAttachment": {"volumeId": "0ab957c0-daa8-4f19-bfbf-0159668d08d7"}} May 25 07:38:16.802873 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:38:16.803700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Cannot 'attach_volume' instance 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 while it is in vm_state rescued May 25 07:38:16.803700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'server_id': '2d5a90d7-311f-4e4a-84c2-ff14c0440bd2', 'body': {'volumeAttachment': {'volumeId': '0ab957c0-daa8-4f19-bfbf-0159668d08d7'}}} May 25 07:38:16.803700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:38:16.803700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:38:16.803700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 25 07:38:16.803700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 25 07:38:16.803700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 07:38:16.803700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 07:38:16.803700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 25 07:38:16.803700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 25 07:38:16.803700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 in vm_state rescued. Cannot attach_volume while the instance is in this state. May 25 07:38:16.803700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:38:16.803700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:38:16.803700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:38:16.803700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:38:16.803700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:38:16.803700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:38:16.803700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:38:16.803700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:38:16.805038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:38:16.805038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:38:16.805038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 07:38:16.805038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 07:38:16.805038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 07:38:16.805038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 07:38:16.805038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 07:38:16.805038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 07:38:16.805038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create May 25 07:38:16.805038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 25 07:38:16.805038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 25 07:38:16.805038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 25 07:38:16.805038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 while it is in vm_state rescued May 25 07:38:16.805038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:38:16.805038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:38:16.805038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:38:16.805038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:38:16.805038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:38:16.805038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:38:16.806460 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:38:16.806460 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:38:16.806460 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 while it is in vm_state rescued May 25 07:38:16.806460 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:38:16.806460 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-6293d81c-4705-42c4-9c3f-387d1e14dfd6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Returning 409 to user: Cannot 'attach_volume' instance 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 while it is in vm_state rescued {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:38:16.806460 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-6293d81c-4705-42c4-9c3f-387d1e14dfd6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "POST /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043568 May 25 07:38:16.806460 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 113/215] 10.222.0.24 () {60 vars in 1322 bytes} [Wed May 25 07:38:16 2022] POST /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 25 07:38:16.812435 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-b70bcdd7-8879-4b91-9a19-9d39060b5592 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:38:16.813027 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-b70bcdd7-8879-4b91-9a19-9d39060b5592 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:16.818877 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b70bcdd7-8879-4b91-9a19-9d39060b5592 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:16.819393 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b70bcdd7-8879-4b91-9a19-9d39060b5592 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:16.820159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b70bcdd7-8879-4b91-9a19-9d39060b5592 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:16.820656 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b70bcdd7-8879-4b91-9a19-9d39060b5592 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:17.032726 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-b70bcdd7-8879-4b91-9a19-9d39060b5592 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "POST /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2/action" status: 202 len: 0 microversion: 2.1 time: 0.224188 May 25 07:38:17.033421 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 103/216] 10.222.0.24 () {60 vars in 1277 bytes} [Wed May 25 07:38:16 2022] POST /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:38:17.042614 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-e663e48a-74f6-42d3-9493-d3ae0fa62626 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:17.043243 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-e663e48a-74f6-42d3-9493-d3ae0fa62626 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:17.049294 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e663e48a-74f6-42d3-9493-d3ae0fa62626 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:17.049846 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e663e48a-74f6-42d3-9493-d3ae0fa62626 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:17.050851 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e663e48a-74f6-42d3-9493-d3ae0fa62626 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:17.051299 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e663e48a-74f6-42d3-9493-d3ae0fa62626 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:17.208072 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-e663e48a-74f6-42d3-9493-d3ae0fa62626 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:17.218889 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-e663e48a-74f6-42d3-9493-d3ae0fa62626 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1506 microversion: 2.1 time: 0.179644 May 25 07:38:17.219770 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 114/217] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:17 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1506 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:38:18.237638 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c81b2411-b84a-4a09-8868-7014dff5994e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:18.238274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c81b2411-b84a-4a09-8868-7014dff5994e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:18.244559 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c81b2411-b84a-4a09-8868-7014dff5994e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:18.245003 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c81b2411-b84a-4a09-8868-7014dff5994e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:18.246741 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c81b2411-b84a-4a09-8868-7014dff5994e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:18.246741 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c81b2411-b84a-4a09-8868-7014dff5994e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:18.381538 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c81b2411-b84a-4a09-8868-7014dff5994e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:18.393052 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c81b2411-b84a-4a09-8868-7014dff5994e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1506 microversion: 2.1 time: 0.159770 May 25 07:38:18.393624 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 104/218] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:18 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1506 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:19.410916 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-9d693d49-0f7e-4714-9958-963f24cdbbb6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:19.411532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-9d693d49-0f7e-4714-9958-963f24cdbbb6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:19.418056 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9d693d49-0f7e-4714-9958-963f24cdbbb6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:19.418567 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9d693d49-0f7e-4714-9958-963f24cdbbb6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:19.419344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9d693d49-0f7e-4714-9958-963f24cdbbb6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:19.419784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9d693d49-0f7e-4714-9958-963f24cdbbb6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:19.564534 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-9d693d49-0f7e-4714-9958-963f24cdbbb6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:19.573238 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-9d693d49-0f7e-4714-9958-963f24cdbbb6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1506 microversion: 2.1 time: 0.166634 May 25 07:38:19.573742 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 115/219] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:19 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1506 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:20.121235 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-0836e31d-d0ef-42d5-99ba-87c022f73ca4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:20.123763 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-0836e31d-d0ef-42d5-99ba-87c022f73ca4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:20.134957 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0836e31d-d0ef-42d5-99ba-87c022f73ca4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:20.135652 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0836e31d-d0ef-42d5-99ba-87c022f73ca4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:20.136762 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0836e31d-d0ef-42d5-99ba-87c022f73ca4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:20.137645 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0836e31d-d0ef-42d5-99ba-87c022f73ca4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:20.169324 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-0836e31d-d0ef-42d5-99ba-87c022f73ca4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b/ips" status: 200 len: 150 microversion: 2.1 time: 0.052466 May 25 07:38:20.170213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 105/220] 10.222.0.24 () {58 vars in 1247 bytes} [Wed May 25 07:38:20 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b/ips => generated 150 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:38:20.593764 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-aa720791-ed6e-43c4-8219-21e4d557a001 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:20.594370 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-aa720791-ed6e-43c4-8219-21e4d557a001 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:20.601846 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-aa720791-ed6e-43c4-8219-21e4d557a001 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:20.602335 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-aa720791-ed6e-43c4-8219-21e4d557a001 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:20.603102 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-aa720791-ed6e-43c4-8219-21e4d557a001 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:20.603544 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-aa720791-ed6e-43c4-8219-21e4d557a001 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:20.737491 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-aa720791-ed6e-43c4-8219-21e4d557a001 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:20.744871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-aa720791-ed6e-43c4-8219-21e4d557a001 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1506 microversion: 2.1 time: 0.155375 May 25 07:38:20.745641 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 116/221] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:20 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:21.761651 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-95312b2d-181c-492d-a039-59b8e30d0382 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:21.762252 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-95312b2d-181c-492d-a039-59b8e30d0382 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:21.768406 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-95312b2d-181c-492d-a039-59b8e30d0382 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:21.768889 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-95312b2d-181c-492d-a039-59b8e30d0382 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:21.769656 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-95312b2d-181c-492d-a039-59b8e30d0382 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:21.770094 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-95312b2d-181c-492d-a039-59b8e30d0382 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:21.910746 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-95312b2d-181c-492d-a039-59b8e30d0382 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:21.918649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-95312b2d-181c-492d-a039-59b8e30d0382 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1506 microversion: 2.1 time: 0.160686 May 25 07:38:21.926103 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 106/222] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:21 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1506 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:22.937253 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-55d948fb-a373-42e3-b67b-d0a95538c0dc tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:22.939377 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-55d948fb-a373-42e3-b67b-d0a95538c0dc tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:22.947145 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-55d948fb-a373-42e3-b67b-d0a95538c0dc tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:22.947608 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-55d948fb-a373-42e3-b67b-d0a95538c0dc tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:22.948574 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-55d948fb-a373-42e3-b67b-d0a95538c0dc tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:22.950712 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-55d948fb-a373-42e3-b67b-d0a95538c0dc tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:23.103463 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-55d948fb-a373-42e3-b67b-d0a95538c0dc tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:23.112725 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-55d948fb-a373-42e3-b67b-d0a95538c0dc tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1512 microversion: 2.1 time: 0.178258 May 25 07:38:23.113520 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 117/223] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:22 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1512 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:23.134065 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-195d7170-d4aa-440c-81a1-0fc11daf74b0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:23.134577 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-195d7170-d4aa-440c-81a1-0fc11daf74b0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:23.140657 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-195d7170-d4aa-440c-81a1-0fc11daf74b0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:23.141110 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-195d7170-d4aa-440c-81a1-0fc11daf74b0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:23.141883 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-195d7170-d4aa-440c-81a1-0fc11daf74b0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:23.142460 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-195d7170-d4aa-440c-81a1-0fc11daf74b0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:23.166928 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-195d7170-d4aa-440c-81a1-0fc11daf74b0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25/ips" status: 200 len: 145 microversion: 2.1 time: 0.036712 May 25 07:38:23.167510 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 107/224] 10.222.0.24 () {58 vars in 1247 bytes} [Wed May 25 07:38:23 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25/ips => generated 145 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:38:24.090838 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ef0d25a1-41c7-481b-8312-40985f539086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:24.096461 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ef0d25a1-41c7-481b-8312-40985f539086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:24.109926 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=30 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:24.111706 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ef0d25a1-41c7-481b-8312-40985f539086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:24.112256 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ef0d25a1-41c7-481b-8312-40985f539086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:24.113323 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ef0d25a1-41c7-481b-8312-40985f539086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:24.113768 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ef0d25a1-41c7-481b-8312-40985f539086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:24.140249 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ef0d25a1-41c7-481b-8312-40985f539086 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd/ips" status: 200 len: 152 microversion: 2.20 time: 0.053167 May 25 07:38:24.142078 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 118/225] 10.222.0.24 () {60 vars in 1288 bytes} [Wed May 25 07:38:24 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd/ips => generated 152 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 07:38:27.333371 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-08b4c30a-7ec2-43c3-a406-26174c77a1d8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f9207fa-dc4c-455f-90c5-23e6a708ee5a"}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:38:27.334684 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-08b4c30a-7ec2-43c3-a406-26174c77a1d8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:27.336621 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=30 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:27.341262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-08b4c30a-7ec2-43c3-a406-26174c77a1d8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:27.341719 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-08b4c30a-7ec2-43c3-a406-26174c77a1d8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:27.342484 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-08b4c30a-7ec2-43c3-a406-26174c77a1d8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:27.342921 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-08b4c30a-7ec2-43c3-a406-26174c77a1d8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:28.295252 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-834c9e30-502e-43da-90ed-ed6ed2023058 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Action: 'create', calling method: .version_select at 0x7fc8656f3790>, body: {"keypair": {"name": "tempest-keypair-657521390", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEAoNgwASJq3wXeZmrlSy9UDU7kE63POgnMbwiEs33RdsJDsh6AXRd4Y7144KuAaSO5nJ8n5YEQmgNaN8BeQ9igT7iEh4tw+d7bLbWDZg9iqR3+jykRkVI4oI0szlTxI+A=="}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:38:28.321034 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-834c9e30-502e-43da-90ed-ed6ed2023058 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Getting quotas for project d4719a4804e24f27b9427e58c5cbe13b. Resources: {'key_pairs'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:38:28.326235 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-834c9e30-502e-43da-90ed-ed6ed2023058 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Getting quotas for user f90f0f6afda54e80bc319dc5bdb80ea6 and project d4719a4804e24f27b9427e58c5cbe13b. Resources: {'key_pairs'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:38:28.487762 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-834c9e30-502e-43da-90ed-ed6ed2023058 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.196565 May 25 07:38:28.488417 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 119/226] 10.222.0.24 () {60 vars in 1158 bytes} [Wed May 25 07:38:28 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:38:28.493509 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a806b1da-4eac-4a79-9f77-2c028e4cf90a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "522fc832-a130-4f97-b5c2-708bac0d5a96"}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:38:28.494894 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a806b1da-4eac-4a79-9f77-2c028e4cf90a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:28.500788 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a806b1da-4eac-4a79-9f77-2c028e4cf90a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:28.501244 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a806b1da-4eac-4a79-9f77-2c028e4cf90a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:28.502015 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a806b1da-4eac-4a79-9f77-2c028e4cf90a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:28.502457 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a806b1da-4eac-4a79-9f77-2c028e4cf90a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:28.521319 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-08b4c30a-7ec2-43c3-a406-26174c77a1d8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "POST /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.192457 May 25 07:38:28.522562 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 108/227] 10.222.0.24 () {60 vars in 1322 bytes} [Wed May 25 07:38:27 2022] POST /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b/os-volume_attachments => generated 194 bytes in 1195 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:38:28.765349 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-e562ccf6-2ad0-4e67-8172-e6d4fe853907 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:38:28.765978 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-e562ccf6-2ad0-4e67-8172-e6d4fe853907 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:28.772333 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e562ccf6-2ad0-4e67-8172-e6d4fe853907 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:28.772819 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e562ccf6-2ad0-4e67-8172-e6d4fe853907 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:28.773592 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e562ccf6-2ad0-4e67-8172-e6d4fe853907 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:28.774033 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e562ccf6-2ad0-4e67-8172-e6d4fe853907 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:28.797238 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.objects.instance [None req-e562ccf6-2ad0-4e67-8172-e6d4fe853907 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lazy-loading 'flavor' on Instance uuid 6d360341-449d-4b49-8b66-a02a969171fd {{(pid=124674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:38:28.921733 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=5,nova_cell1:INSERT=2 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:29.494663 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-e562ccf6-2ad0-4e67-8172-e6d4fe853907 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "POST /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd/action" status: 202 len: 0 microversion: 2.20 time: 0.733789 May 25 07:38:29.495429 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 109/228] 10.222.0.24 () {62 vars in 1318 bytes} [Wed May 25 07:38:28 2022] POST /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd/action => generated 0 bytes in 736 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) May 25 07:38:29.505299 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-002210e1-2e2b-4da4-af11-16b25fdc0cc4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:29.505741 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-002210e1-2e2b-4da4-af11-16b25fdc0cc4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:29.512191 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-002210e1-2e2b-4da4-af11-16b25fdc0cc4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:29.512794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-002210e1-2e2b-4da4-af11-16b25fdc0cc4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:29.513622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-002210e1-2e2b-4da4-af11-16b25fdc0cc4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:29.514102 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-002210e1-2e2b-4da4-af11-16b25fdc0cc4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:29.668595 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-002210e1-2e2b-4da4-af11-16b25fdc0cc4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:29.676851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-002210e1-2e2b-4da4-af11-16b25fdc0cc4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:29.678387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-002210e1-2e2b-4da4-af11-16b25fdc0cc4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:29.679565 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-002210e1-2e2b-4da4-af11-16b25fdc0cc4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.179847 May 25 07:38:29.680129 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 110/229] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:29 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:38:30.698123 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-9ef5959b-f238-4d2c-aa17-3d0edb01fee6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:30.698788 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-9ef5959b-f238-4d2c-aa17-3d0edb01fee6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:30.706192 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9ef5959b-f238-4d2c-aa17-3d0edb01fee6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:30.707979 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9ef5959b-f238-4d2c-aa17-3d0edb01fee6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:30.707979 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9ef5959b-f238-4d2c-aa17-3d0edb01fee6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:30.707979 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9ef5959b-f238-4d2c-aa17-3d0edb01fee6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:30.906465 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9ef5959b-f238-4d2c-aa17-3d0edb01fee6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:30.920491 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9ef5959b-f238-4d2c-aa17-3d0edb01fee6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:30.922055 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9ef5959b-f238-4d2c-aa17-3d0edb01fee6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:30.923975 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-9ef5959b-f238-4d2c-aa17-3d0edb01fee6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.229379 May 25 07:38:30.924401 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 111/230] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:30 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:38:31.246243 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7abfced9-49d8-4c32-ae08-1ef17db54ef1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1490532630", "imageRef": "ddc5b622-a846-425a-b8fd-7e5caef00bf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e9255b8f-85b1-4659-9bc1-7aaec6681338"}], "security_groups": [{"name": "tempest-securitygroup--1367616094"}], "key_name": "tempest-keypair-657521390", "user_data": "}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:38:31.401599 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.network.neutron [None req-7abfced9-49d8-4c32-ae08-1ef17db54ef1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] validate_networks() for [('e9255b8f-85b1-4659-9bc1-7aaec6681338', None, None, None, None, None)] {{(pid=124674) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:38:31.943604 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a806b1da-4eac-4a79-9f77-2c028e4cf90a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "POST /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.453489 May 25 07:38:31.944223 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 120/231] 10.222.0.24 () {60 vars in 1322 bytes} [Wed May 25 07:38:28 2022] POST /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25/os-volume_attachments => generated 194 bytes in 3455 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:38:31.959167 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-c3c1a2b3-62fc-4212-8b80-5b5796f65348 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:31.959910 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-c3c1a2b3-62fc-4212-8b80-5b5796f65348 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:31.967426 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c3c1a2b3-62fc-4212-8b80-5b5796f65348 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:31.968069 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c3c1a2b3-62fc-4212-8b80-5b5796f65348 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:31.973008 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c3c1a2b3-62fc-4212-8b80-5b5796f65348 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:31.973008 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c3c1a2b3-62fc-4212-8b80-5b5796f65348 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:32.017136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-7abfced9-49d8-4c32-ae08-1ef17db54ef1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Flavor limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:38:32.017647 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-7abfced9-49d8-4c32-ae08-1ef17db54ef1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Image limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:38:32.018015 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-7abfced9-49d8-4c32-ae08-1ef17db54ef1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Flavor pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:38:32.018528 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-7abfced9-49d8-4c32-ae08-1ef17db54ef1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Image pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:38:32.018945 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-7abfced9-49d8-4c32-ae08-1ef17db54ef1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:38:32.028803 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7abfced9-49d8-4c32-ae08-1ef17db54ef1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:32.030738 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7abfced9-49d8-4c32-ae08-1ef17db54ef1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:32.030738 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7abfced9-49d8-4c32-ae08-1ef17db54ef1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:32.030738 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7abfced9-49d8-4c32-ae08-1ef17db54ef1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:32.057780 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-7abfced9-49d8-4c32-ae08-1ef17db54ef1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Getting quotas for project d4719a4804e24f27b9427e58c5cbe13b. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:38:32.061980 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-7abfced9-49d8-4c32-ae08-1ef17db54ef1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Getting quotas for user f90f0f6afda54e80bc319dc5bdb80ea6 and project d4719a4804e24f27b9427e58c5cbe13b. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:38:32.074421 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-7abfced9-49d8-4c32-ae08-1ef17db54ef1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Going to run 1 instances... {{(pid=124674) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:38:32.077434 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-7abfced9-49d8-4c32-ae08-1ef17db54ef1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddc5b622-a846-425a-b8fd-7e5caef00bf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:38:32.117294 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-c3c1a2b3-62fc-4212-8b80-5b5796f65348 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:32.125237 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-c3c1a2b3-62fc-4212-8b80-5b5796f65348 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:32.126754 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-c3c1a2b3-62fc-4212-8b80-5b5796f65348 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:32.128912 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-c3c1a2b3-62fc-4212-8b80-5b5796f65348 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.182284 May 25 07:38:32.129508 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 121/232] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:31 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:38:32.281050 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-7abfced9-49d8-4c32-ae08-1ef17db54ef1 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 409 microversion: 2.1 time: 1.039467 May 25 07:38:32.281690 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 112/233] 10.222.0.24 () {60 vars in 1146 bytes} [Wed May 25 07:38:31 2022] POST /compute/v2.1/servers => generated 409 bytes in 1041 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 07:38:32.292948 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-03c5e6b6-b814-4d0e-8400-91f1478dd838 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:32.293566 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-03c5e6b6-b814-4d0e-8400-91f1478dd838 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:32.350880 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-03c5e6b6-b814-4d0e-8400-91f1478dd838 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:32.358157 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-03c5e6b6-b814-4d0e-8400-91f1478dd838 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1245 microversion: 2.1 time: 0.069457 May 25 07:38:32.358738 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 122/234] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:32 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1245 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:33.149326 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d6d363d4-28af-4aac-b90e-96467ca5dca1 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:33.149895 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d6d363d4-28af-4aac-b90e-96467ca5dca1 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:33.158257 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d6d363d4-28af-4aac-b90e-96467ca5dca1 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:33.158257 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d6d363d4-28af-4aac-b90e-96467ca5dca1 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:33.158650 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d6d363d4-28af-4aac-b90e-96467ca5dca1 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:33.159033 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d6d363d4-28af-4aac-b90e-96467ca5dca1 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:33.340302 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d6d363d4-28af-4aac-b90e-96467ca5dca1 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:33.348603 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d6d363d4-28af-4aac-b90e-96467ca5dca1 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:33.350184 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d6d363d4-28af-4aac-b90e-96467ca5dca1 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:33.351355 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d6d363d4-28af-4aac-b90e-96467ca5dca1 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.207449 May 25 07:38:33.352101 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 113/235] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:33 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:38:33.377389 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-857dd948-d7b2-4588-9279-6880880989ff tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:33.378011 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-857dd948-d7b2-4588-9279-6880880989ff tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:33.386307 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-857dd948-d7b2-4588-9279-6880880989ff tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:33.386762 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-857dd948-d7b2-4588-9279-6880880989ff tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:33.387663 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-857dd948-d7b2-4588-9279-6880880989ff tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:33.388891 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-857dd948-d7b2-4588-9279-6880880989ff tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:33.478679 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-857dd948-d7b2-4588-9279-6880880989ff tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:33.487027 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-857dd948-d7b2-4588-9279-6880880989ff tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1249 microversion: 2.1 time: 0.114282 May 25 07:38:33.489824 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 123/236] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:33 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1249 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:34.378325 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-00936e20-142f-4d8f-a5c8-2aa849767a6f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:34.379192 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-00936e20-142f-4d8f-a5c8-2aa849767a6f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:34.386235 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-00936e20-142f-4d8f-a5c8-2aa849767a6f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:34.386730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-00936e20-142f-4d8f-a5c8-2aa849767a6f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:34.387550 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-00936e20-142f-4d8f-a5c8-2aa849767a6f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:34.387993 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-00936e20-142f-4d8f-a5c8-2aa849767a6f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:34.505623 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b5228ce0-4ebf-41d0-b38c-a1224d39364b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:34.506229 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b5228ce0-4ebf-41d0-b38c-a1224d39364b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:34.512573 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b5228ce0-4ebf-41d0-b38c-a1224d39364b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:34.513028 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b5228ce0-4ebf-41d0-b38c-a1224d39364b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:34.513789 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b5228ce0-4ebf-41d0-b38c-a1224d39364b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:34.514219 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b5228ce0-4ebf-41d0-b38c-a1224d39364b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:34.516001 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-00936e20-142f-4d8f-a5c8-2aa849767a6f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:34.525104 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-00936e20-142f-4d8f-a5c8-2aa849767a6f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:34.526825 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-00936e20-142f-4d8f-a5c8-2aa849767a6f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:34.528065 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-00936e20-142f-4d8f-a5c8-2aa849767a6f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.153734 May 25 07:38:34.528799 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 114/237] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:34 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:38:34.574646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b5228ce0-4ebf-41d0-b38c-a1224d39364b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:34.582497 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b5228ce0-4ebf-41d0-b38c-a1224d39364b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1249 microversion: 2.1 time: 0.081242 May 25 07:38:34.583098 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 124/238] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:34 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1249 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:38:35.546660 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1f578ee7-339f-4804-9021-d68f60824dd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:35.547290 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-1f578ee7-339f-4804-9021-d68f60824dd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:35.553855 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1f578ee7-339f-4804-9021-d68f60824dd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:35.554551 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1f578ee7-339f-4804-9021-d68f60824dd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:35.555311 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1f578ee7-339f-4804-9021-d68f60824dd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:35.555739 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1f578ee7-339f-4804-9021-d68f60824dd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:35.600200 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-69340a19-71c4-49a2-a719-e038304ea579 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:35.600857 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-69340a19-71c4-49a2-a719-e038304ea579 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:35.608756 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-69340a19-71c4-49a2-a719-e038304ea579 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:35.609252 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-69340a19-71c4-49a2-a719-e038304ea579 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:35.610101 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-69340a19-71c4-49a2-a719-e038304ea579 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:35.610545 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-69340a19-71c4-49a2-a719-e038304ea579 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:35.678099 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-69340a19-71c4-49a2-a719-e038304ea579 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:35.686827 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-69340a19-71c4-49a2-a719-e038304ea579 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1249 microversion: 2.1 time: 0.091363 May 25 07:38:35.687769 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 125/239] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:35 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1249 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:35.707842 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1f578ee7-339f-4804-9021-d68f60824dd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:35.717616 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1f578ee7-339f-4804-9021-d68f60824dd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:35.720197 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1f578ee7-339f-4804-9021-d68f60824dd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:35.721416 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-1f578ee7-339f-4804-9021-d68f60824dd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.178867 May 25 07:38:35.722594 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 115/240] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:35 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:38:36.704800 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-39291424-a9b2-4f72-ac24-84b1689b27cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:36.704800 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-39291424-a9b2-4f72-ac24-84b1689b27cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:36.710681 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-39291424-a9b2-4f72-ac24-84b1689b27cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:36.711132 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-39291424-a9b2-4f72-ac24-84b1689b27cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:36.711974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-39291424-a9b2-4f72-ac24-84b1689b27cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:36.712456 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-39291424-a9b2-4f72-ac24-84b1689b27cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:36.742906 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-395184df-dc87-46d1-afd0-7c6343cfca86 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:36.743726 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-395184df-dc87-46d1-afd0-7c6343cfca86 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:36.751719 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-395184df-dc87-46d1-afd0-7c6343cfca86 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:36.752164 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-395184df-dc87-46d1-afd0-7c6343cfca86 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:36.752972 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-395184df-dc87-46d1-afd0-7c6343cfca86 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:36.753502 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-395184df-dc87-46d1-afd0-7c6343cfca86 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:36.788608 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-39291424-a9b2-4f72-ac24-84b1689b27cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:36.796087 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-39291424-a9b2-4f72-ac24-84b1689b27cf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1297 microversion: 2.1 time: 0.096442 May 25 07:38:36.796675 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 126/241] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:36 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1297 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:38:36.990277 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-395184df-dc87-46d1-afd0-7c6343cfca86 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:37.006697 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-395184df-dc87-46d1-afd0-7c6343cfca86 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:37.009968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-395184df-dc87-46d1-afd0-7c6343cfca86 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:37.011734 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-395184df-dc87-46d1-afd0-7c6343cfca86 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.272595 May 25 07:38:37.014652 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 116/242] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:36 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:38:37.814166 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-19070192-6857-4b15-a009-06ce375460e2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:37.815347 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-19070192-6857-4b15-a009-06ce375460e2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:37.822027 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-19070192-6857-4b15-a009-06ce375460e2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:37.822479 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-19070192-6857-4b15-a009-06ce375460e2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:37.823245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-19070192-6857-4b15-a009-06ce375460e2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:37.823681 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-19070192-6857-4b15-a009-06ce375460e2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:38.002107 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-19070192-6857-4b15-a009-06ce375460e2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:38.010310 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-19070192-6857-4b15-a009-06ce375460e2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1371 microversion: 2.1 time: 0.199938 May 25 07:38:38.010988 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 127/243] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:37 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1371 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:38.033517 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-178447ef-184f-4e97-b7fb-7321d7fdc707 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:38.036746 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-178447ef-184f-4e97-b7fb-7321d7fdc707 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:38.044005 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-178447ef-184f-4e97-b7fb-7321d7fdc707 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:38.044739 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-178447ef-184f-4e97-b7fb-7321d7fdc707 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:38.046081 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-178447ef-184f-4e97-b7fb-7321d7fdc707 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:38.046761 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-178447ef-184f-4e97-b7fb-7321d7fdc707 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:38.326850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-178447ef-184f-4e97-b7fb-7321d7fdc707 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:38.336337 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-178447ef-184f-4e97-b7fb-7321d7fdc707 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:38.348797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-178447ef-184f-4e97-b7fb-7321d7fdc707 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:38.350251 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-178447ef-184f-4e97-b7fb-7321d7fdc707 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.321801 May 25 07:38:38.350820 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 117/244] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:38 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:38:39.028338 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-e2462e4a-cf08-4152-a62a-a2be6cd84451 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:39.029822 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-e2462e4a-cf08-4152-a62a-a2be6cd84451 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:39.041303 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e2462e4a-cf08-4152-a62a-a2be6cd84451 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:39.041303 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e2462e4a-cf08-4152-a62a-a2be6cd84451 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:39.042436 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e2462e4a-cf08-4152-a62a-a2be6cd84451 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:39.043040 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e2462e4a-cf08-4152-a62a-a2be6cd84451 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:39.193635 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-e2462e4a-cf08-4152-a62a-a2be6cd84451 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:39.204642 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-e2462e4a-cf08-4152-a62a-a2be6cd84451 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1371 microversion: 2.1 time: 0.179027 May 25 07:38:39.204642 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 128/245] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:39 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1371 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:39.370181 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-767856fd-65f3-4a4b-a7f8-543d4963e748 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:39.370996 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-767856fd-65f3-4a4b-a7f8-543d4963e748 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:39.384375 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-767856fd-65f3-4a4b-a7f8-543d4963e748 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:39.386229 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-0c8b6f87-42ec-49b5-8c2d-357645c583ac req-7b4818bd-2826-4a30-b4e6-e18dcd625f3b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5ef563c-52c0-40b3-bdf3-dc51e5422196", "tag": "0747a8fb-24f2-4911-87f0-c806befeeab7"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:38:39.386382 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-767856fd-65f3-4a4b-a7f8-543d4963e748 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:39.387078 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-767856fd-65f3-4a4b-a7f8-543d4963e748 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:39.388879 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-767856fd-65f3-4a4b-a7f8-543d4963e748 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:39.396185 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-0c8b6f87-42ec-49b5-8c2d-357645c583ac req-7b4818bd-2826-4a30-b4e6-e18dcd625f3b service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:39.396947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-0c8b6f87-42ec-49b5-8c2d-357645c583ac req-7b4818bd-2826-4a30-b4e6-e18dcd625f3b service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:39.421165 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:39.423356 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-0c8b6f87-42ec-49b5-8c2d-357645c583ac req-7b4818bd-2826-4a30-b4e6-e18dcd625f3b service nova] Creating event network-changed:0747a8fb-24f2-4911-87f0-c806befeeab7 for instance a5ef563c-52c0-40b3-bdf3-dc51e5422196 on hv-cinder-82549 May 25 07:38:39.429553 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-0c8b6f87-42ec-49b5-8c2d-357645c583ac req-7b4818bd-2826-4a30-b4e6-e18dcd625f3b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046877 May 25 07:38:39.430228 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 129/246] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:38:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:38:39.438040 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-0495f042-984d-4a08-bbbb-21ec544f4803 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Action: 'create', calling method: .version_select at 0x7fc8644c3af0>, body: {"keypair": {"name": "tempest-keypair-796272905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJMVdqMCMotJHWEEjBKqQrGmARnHQ/cUwSnmhTiTykNWs3uq5zaFwbW1bJQGedPCHgLMSxPrEabQtrpANpwrZyFhqJHn1cTQLhq3rA0u2exVratgiXx2u7s8O4TIWnrecg=="}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:38:39.463306 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-0495f042-984d-4a08-bbbb-21ec544f4803 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Getting quotas for project 2d8e35800ce043acbcb027ce406ed2e7. Resources: {'key_pairs'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:38:39.468068 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-0495f042-984d-4a08-bbbb-21ec544f4803 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Getting quotas for user 0487ea9076ee4baf8138fdc25ce02522 and project 2d8e35800ce043acbcb027ce406ed2e7. Resources: {'key_pairs'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:38:39.658171 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-767856fd-65f3-4a4b-a7f8-543d4963e748 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:39.667191 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-767856fd-65f3-4a4b-a7f8-543d4963e748 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:39.668759 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-767856fd-65f3-4a4b-a7f8-543d4963e748 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:39.669956 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-767856fd-65f3-4a4b-a7f8-543d4963e748 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.303917 May 25 07:38:39.670515 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 118/247] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:39 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 305 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:38:39.687517 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-0495f042-984d-4a08-bbbb-21ec544f4803 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.253316 May 25 07:38:39.688326 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 130/248] 10.222.0.24 () {60 vars in 1158 bytes} [Wed May 25 07:38:39 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:38:40.220533 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-351a2a1c-493f-4ae3-979b-5ee82bd1abb0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:40.221139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-351a2a1c-493f-4ae3-979b-5ee82bd1abb0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:40.228220 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-351a2a1c-493f-4ae3-979b-5ee82bd1abb0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:40.228712 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-351a2a1c-493f-4ae3-979b-5ee82bd1abb0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:40.229575 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-351a2a1c-493f-4ae3-979b-5ee82bd1abb0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:40.230254 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-351a2a1c-493f-4ae3-979b-5ee82bd1abb0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:40.416942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-351a2a1c-493f-4ae3-979b-5ee82bd1abb0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:40.429879 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-351a2a1c-493f-4ae3-979b-5ee82bd1abb0 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1371 microversion: 2.1 time: 0.213427 May 25 07:38:40.430470 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 119/249] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:40 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1371 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:40.689763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-3e542828-fb9c-4adb-af20-d7e666c95c10 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:40.690492 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-3e542828-fb9c-4adb-af20-d7e666c95c10 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:40.697549 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3e542828-fb9c-4adb-af20-d7e666c95c10 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:40.698007 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3e542828-fb9c-4adb-af20-d7e666c95c10 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:40.698801 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3e542828-fb9c-4adb-af20-d7e666c95c10 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:40.699240 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3e542828-fb9c-4adb-af20-d7e666c95c10 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:40.837226 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-3e542828-fb9c-4adb-af20-d7e666c95c10 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:40.845383 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-3e542828-fb9c-4adb-af20-d7e666c95c10 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:40.848072 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-3e542828-fb9c-4adb-af20-d7e666c95c10 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:40.849611 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-3e542828-fb9c-4adb-af20-d7e666c95c10 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.164353 May 25 07:38:40.851878 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 131/250] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:40 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:38:41.455175 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-559d9977-1bb6-497f-9cad-682100c7a0bf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:41.457973 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-559d9977-1bb6-497f-9cad-682100c7a0bf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:41.467808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-559d9977-1bb6-497f-9cad-682100c7a0bf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:41.468342 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-559d9977-1bb6-497f-9cad-682100c7a0bf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:41.469341 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-559d9977-1bb6-497f-9cad-682100c7a0bf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:41.470061 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-559d9977-1bb6-497f-9cad-682100c7a0bf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:41.716438 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-559d9977-1bb6-497f-9cad-682100c7a0bf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:41.738182 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-559d9977-1bb6-497f-9cad-682100c7a0bf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1371 microversion: 2.1 time: 0.293538 May 25 07:38:41.747557 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 120/251] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:41 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1371 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:41.868814 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-5144a00e-3082-4c98-bb0f-e910f03f9493 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:41.869427 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-5144a00e-3082-4c98-bb0f-e910f03f9493 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:41.876145 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5144a00e-3082-4c98-bb0f-e910f03f9493 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:41.876622 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5144a00e-3082-4c98-bb0f-e910f03f9493 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:41.877530 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5144a00e-3082-4c98-bb0f-e910f03f9493 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:41.878048 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5144a00e-3082-4c98-bb0f-e910f03f9493 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:42.051011 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-5144a00e-3082-4c98-bb0f-e910f03f9493 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:42.060310 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-5144a00e-3082-4c98-bb0f-e910f03f9493 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:42.062115 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-5144a00e-3082-4c98-bb0f-e910f03f9493 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:42.063386 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-5144a00e-3082-4c98-bb0f-e910f03f9493 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.198891 May 25 07:38:42.065400 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 132/252] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:41 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:38:42.755577 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-b4a2554c-0f2f-4e5a-ae63-cfe5dd86b4b7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2746934", "imageRef": "ddc5b622-a846-425a-b8fd-7e5caef00bf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f39d85d3-0173-4496-879c-2b83e234d364"}], "security_groups": [{"name": "tempest-securitygroup--1467068966"}], "key_name": "tempest-keypair-796272905", "user_data": "}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:38:42.756091 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-7bde205b-2773-4aa8-a3b2-a0e95e3c431b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:42.756303 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-7bde205b-2773-4aa8-a3b2-a0e95e3c431b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:42.762361 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7bde205b-2773-4aa8-a3b2-a0e95e3c431b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:42.763664 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7bde205b-2773-4aa8-a3b2-a0e95e3c431b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:42.763786 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=2 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:42.763904 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7bde205b-2773-4aa8-a3b2-a0e95e3c431b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:42.764082 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7bde205b-2773-4aa8-a3b2-a0e95e3c431b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:42.764197 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=6 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:42.882220 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.network.neutron [None req-b4a2554c-0f2f-4e5a-ae63-cfe5dd86b4b7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] validate_networks() for [('f39d85d3-0173-4496-879c-2b83e234d364', None, None, None, None, None)] {{(pid=124674) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:38:42.908364 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-7bde205b-2773-4aa8-a3b2-a0e95e3c431b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:42.917263 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-7bde205b-2773-4aa8-a3b2-a0e95e3c431b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1371 microversion: 2.1 time: 0.166090 May 25 07:38:42.917843 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 133/253] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:42 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:38:43.089550 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ee90b888-c90a-43fa-9dea-4c97ae98daf4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:43.091113 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ee90b888-c90a-43fa-9dea-4c97ae98daf4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:43.120528 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ee90b888-c90a-43fa-9dea-4c97ae98daf4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:43.125086 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ee90b888-c90a-43fa-9dea-4c97ae98daf4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:43.130589 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ee90b888-c90a-43fa-9dea-4c97ae98daf4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:43.130589 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ee90b888-c90a-43fa-9dea-4c97ae98daf4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:43.310469 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-b4a2554c-0f2f-4e5a-ae63-cfe5dd86b4b7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Flavor limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:38:43.311386 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-b4a2554c-0f2f-4e5a-ae63-cfe5dd86b4b7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Image limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:38:43.312030 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-b4a2554c-0f2f-4e5a-ae63-cfe5dd86b4b7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Flavor pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:38:43.312613 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-b4a2554c-0f2f-4e5a-ae63-cfe5dd86b4b7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Image pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:38:43.313160 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-b4a2554c-0f2f-4e5a-ae63-cfe5dd86b4b7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:38:43.326636 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b4a2554c-0f2f-4e5a-ae63-cfe5dd86b4b7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:43.327082 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ee90b888-c90a-43fa-9dea-4c97ae98daf4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:43.327215 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b4a2554c-0f2f-4e5a-ae63-cfe5dd86b4b7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:43.327934 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b4a2554c-0f2f-4e5a-ae63-cfe5dd86b4b7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:43.328377 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b4a2554c-0f2f-4e5a-ae63-cfe5dd86b4b7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:43.342131 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ee90b888-c90a-43fa-9dea-4c97ae98daf4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:43.343445 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ee90b888-c90a-43fa-9dea-4c97ae98daf4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:43.345259 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ee90b888-c90a-43fa-9dea-4c97ae98daf4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.260046 May 25 07:38:43.346549 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 134/254] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:43 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:38:43.352467 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-b4a2554c-0f2f-4e5a-ae63-cfe5dd86b4b7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Getting quotas for project 2d8e35800ce043acbcb027ce406ed2e7. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:38:43.358231 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-b4a2554c-0f2f-4e5a-ae63-cfe5dd86b4b7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Getting quotas for user 0487ea9076ee4baf8138fdc25ce02522 and project 2d8e35800ce043acbcb027ce406ed2e7. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:38:43.380020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-b4a2554c-0f2f-4e5a-ae63-cfe5dd86b4b7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Going to run 1 instances... {{(pid=124674) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:38:43.383350 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-b4a2554c-0f2f-4e5a-ae63-cfe5dd86b4b7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddc5b622-a846-425a-b8fd-7e5caef00bf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:38:43.483685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-b4a2554c-0f2f-4e5a-ae63-cfe5dd86b4b7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.733019 May 25 07:38:43.484530 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 121/255] 10.222.0.24 () {60 vars in 1146 bytes} [Wed May 25 07:38:42 2022] POST /compute/v2.1/servers => generated 402 bytes in 734 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 07:38:43.497173 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-d07c0a8e-e828-47b6-8bea-84228352e817 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:43.498188 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-d07c0a8e-e828-47b6-8bea-84228352e817 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:43.565152 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d07c0a8e-e828-47b6-8bea-84228352e817 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:43.575132 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-d07c0a8e-e828-47b6-8bea-84228352e817 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 200 len: 1238 microversion: 2.1 time: 0.082891 May 25 07:38:43.576719 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 135/256] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:43 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 1238 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:43.934645 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d8ce2e79-5d04-4852-a276-71e0f1895e5c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:43.935305 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d8ce2e79-5d04-4852-a276-71e0f1895e5c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:43.944194 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d8ce2e79-5d04-4852-a276-71e0f1895e5c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:43.944688 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d8ce2e79-5d04-4852-a276-71e0f1895e5c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:43.946704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d8ce2e79-5d04-4852-a276-71e0f1895e5c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:43.947159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d8ce2e79-5d04-4852-a276-71e0f1895e5c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:44.088284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d8ce2e79-5d04-4852-a276-71e0f1895e5c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:44.096209 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d8ce2e79-5d04-4852-a276-71e0f1895e5c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1371 microversion: 2.1 time: 0.165636 May 25 07:38:44.097094 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 122/257] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:43 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1371 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:44.364783 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-5d17cb25-2a3e-49e5-bc76-5ce593b622d5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:44.365615 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-5d17cb25-2a3e-49e5-bc76-5ce593b622d5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:44.373918 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5d17cb25-2a3e-49e5-bc76-5ce593b622d5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:44.374455 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5d17cb25-2a3e-49e5-bc76-5ce593b622d5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:44.375494 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5d17cb25-2a3e-49e5-bc76-5ce593b622d5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:44.375941 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5d17cb25-2a3e-49e5-bc76-5ce593b622d5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:44.518923 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-5d17cb25-2a3e-49e5-bc76-5ce593b622d5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:44.527515 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-5d17cb25-2a3e-49e5-bc76-5ce593b622d5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:44.529235 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-5d17cb25-2a3e-49e5-bc76-5ce593b622d5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:44.530315 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-5d17cb25-2a3e-49e5-bc76-5ce593b622d5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.170595 May 25 07:38:44.531123 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 136/258] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:44 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:38:44.593011 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-a6b043ec-456f-4495-90a6-934e674a265a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:44.593620 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-a6b043ec-456f-4495-90a6-934e674a265a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:44.600335 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a6b043ec-456f-4495-90a6-934e674a265a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:44.600800 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a6b043ec-456f-4495-90a6-934e674a265a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:44.601565 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a6b043ec-456f-4495-90a6-934e674a265a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:44.601994 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a6b043ec-456f-4495-90a6-934e674a265a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:44.663092 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a6b043ec-456f-4495-90a6-934e674a265a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:44.671334 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-a6b043ec-456f-4495-90a6-934e674a265a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 200 len: 1242 microversion: 2.1 time: 0.082189 May 25 07:38:44.672187 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 123/259] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:44 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 1242 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:45.114204 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-48c0e657-a372-4592-884d-787a2e1fe6e8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:45.117923 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-48c0e657-a372-4592-884d-787a2e1fe6e8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:45.121097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-48c0e657-a372-4592-884d-787a2e1fe6e8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:45.121556 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-48c0e657-a372-4592-884d-787a2e1fe6e8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:45.122338 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-48c0e657-a372-4592-884d-787a2e1fe6e8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:45.122781 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-48c0e657-a372-4592-884d-787a2e1fe6e8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:45.252196 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-48c0e657-a372-4592-884d-787a2e1fe6e8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:45.261803 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-48c0e657-a372-4592-884d-787a2e1fe6e8 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1371 microversion: 2.1 time: 0.151680 May 25 07:38:45.262663 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 137/260] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:45 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:45.358282 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-73cc4785-d09f-4334-a2fa-555e7f08cd4b req-bb013ca8-a3c9-4106-8667-3adbacfc0363 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5ef563c-52c0-40b3-bdf3-dc51e5422196", "name": "network-vif-plugged", "status": "completed", "tag": "0747a8fb-24f2-4911-87f0-c806befeeab7"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:38:45.368682 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-73cc4785-d09f-4334-a2fa-555e7f08cd4b req-bb013ca8-a3c9-4106-8667-3adbacfc0363 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:45.369449 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-73cc4785-d09f-4334-a2fa-555e7f08cd4b req-bb013ca8-a3c9-4106-8667-3adbacfc0363 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:45.383075 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-73cc4785-d09f-4334-a2fa-555e7f08cd4b req-bb013ca8-a3c9-4106-8667-3adbacfc0363 service nova] Creating event network-vif-plugged:0747a8fb-24f2-4911-87f0-c806befeeab7 for instance a5ef563c-52c0-40b3-bdf3-dc51e5422196 on hv-cinder-82549 May 25 07:38:45.389416 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-73cc4785-d09f-4334-a2fa-555e7f08cd4b req-bb013ca8-a3c9-4106-8667-3adbacfc0363 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034961 May 25 07:38:45.390025 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 124/261] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:38:45 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:38:45.414899 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-9fe1aabc-1b09-4d44-b828-75eaabaf5144 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1525232693", "imageRef": "ddc5b622-a846-425a-b8fd-7e5caef00bf8", "flavorRef": "452"}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:38:45.483574 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.network.neutron [None req-9fe1aabc-1b09-4d44-b828-75eaabaf5144 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] validate_networks() for None {{(pid=124675) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:38:45.549237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-252321cb-d104-44c5-82e5-c7f953079f1f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:45.549944 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-252321cb-d104-44c5-82e5-c7f953079f1f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:45.559137 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-252321cb-d104-44c5-82e5-c7f953079f1f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:45.559610 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-252321cb-d104-44c5-82e5-c7f953079f1f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:45.560613 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-252321cb-d104-44c5-82e5-c7f953079f1f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:45.561048 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-252321cb-d104-44c5-82e5-c7f953079f1f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:45.729898 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-252321cb-d104-44c5-82e5-c7f953079f1f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:45.739127 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-252321cb-d104-44c5-82e5-c7f953079f1f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:45.740839 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-252321cb-d104-44c5-82e5-c7f953079f1f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:45.742071 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-252321cb-d104-44c5-82e5-c7f953079f1f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.197230 May 25 07:38:45.742636 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 125/262] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:45 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:38:45.751065 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-56b202bd-01d0-4de9-8d59-65485d748f22 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:45.751987 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-56b202bd-01d0-4de9-8d59-65485d748f22 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:45.759321 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-56b202bd-01d0-4de9-8d59-65485d748f22 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:45.759775 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-56b202bd-01d0-4de9-8d59-65485d748f22 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:45.760566 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-56b202bd-01d0-4de9-8d59-65485d748f22 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:45.765533 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-56b202bd-01d0-4de9-8d59-65485d748f22 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:45.798072 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-9fe1aabc-1b09-4d44-b828-75eaabaf5144 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Flavor limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:38:45.798495 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-9fe1aabc-1b09-4d44-b828-75eaabaf5144 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Image limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:38:45.798965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-9fe1aabc-1b09-4d44-b828-75eaabaf5144 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Flavor pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:38:45.799371 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-9fe1aabc-1b09-4d44-b828-75eaabaf5144 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Image pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:38:45.799787 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-9fe1aabc-1b09-4d44-b828-75eaabaf5144 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:38:45.809623 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9fe1aabc-1b09-4d44-b828-75eaabaf5144 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:45.810066 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9fe1aabc-1b09-4d44-b828-75eaabaf5144 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:45.810857 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9fe1aabc-1b09-4d44-b828-75eaabaf5144 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:45.811297 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9fe1aabc-1b09-4d44-b828-75eaabaf5144 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:45.829051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-9fe1aabc-1b09-4d44-b828-75eaabaf5144 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Getting quotas for project 200c28fbfe02445e947d289ab4d36793. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:38:45.829750 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-56b202bd-01d0-4de9-8d59-65485d748f22 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:45.834503 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-9fe1aabc-1b09-4d44-b828-75eaabaf5144 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Getting quotas for user c2c35b5419b14e288746992ca45065e5 and project 200c28fbfe02445e947d289ab4d36793. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:38:45.837967 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-56b202bd-01d0-4de9-8d59-65485d748f22 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 200 len: 1290 microversion: 2.1 time: 0.092413 May 25 07:38:45.838573 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 126/263] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:45 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 1290 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:45.844733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-9fe1aabc-1b09-4d44-b828-75eaabaf5144 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Going to run 1 instances... {{(pid=124675) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:38:45.846976 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-9fe1aabc-1b09-4d44-b828-75eaabaf5144 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddc5b622-a846-425a-b8fd-7e5caef00bf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:38:46.004100 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-9fe1aabc-1b09-4d44-b828-75eaabaf5144 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.594229 May 25 07:38:46.005057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 138/264] 10.222.0.24 () {60 vars in 1146 bytes} [Wed May 25 07:38:45 2022] POST /compute/v2.1/servers => generated 380 bytes in 596 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 07:38:46.015291 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-6028a4fc-2e94-460e-adf0-9b6af3bf94ad tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:46.015898 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-6028a4fc-2e94-460e-adf0-9b6af3bf94ad tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:46.069277 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-6028a4fc-2e94-460e-adf0-9b6af3bf94ad tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c35b5419b14e288746992ca45065e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200c28fbfe02445e947d289ab4d36793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:46.081081 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-6028a4fc-2e94-460e-adf0-9b6af3bf94ad tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 200 len: 1215 microversion: 2.1 time: 0.069836 May 25 07:38:46.082365 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 127/265] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:46 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 1215 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:46.282047 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-3916ce96-5bd9-4e50-a737-9965d502a4a9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:46.282611 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-3916ce96-5bd9-4e50-a737-9965d502a4a9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:46.289863 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3916ce96-5bd9-4e50-a737-9965d502a4a9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:46.290318 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3916ce96-5bd9-4e50-a737-9965d502a4a9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:46.291075 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3916ce96-5bd9-4e50-a737-9965d502a4a9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:46.291511 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3916ce96-5bd9-4e50-a737-9965d502a4a9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:46.419771 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-3916ce96-5bd9-4e50-a737-9965d502a4a9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:46.448103 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-3916ce96-5bd9-4e50-a737-9965d502a4a9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1371 microversion: 2.1 time: 0.169888 May 25 07:38:46.448872 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 139/266] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:46 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1371 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:46.761786 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-21af668e-aba0-4036-974c-f95c15ab86b4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:46.762408 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-21af668e-aba0-4036-974c-f95c15ab86b4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:46.769815 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-21af668e-aba0-4036-974c-f95c15ab86b4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:46.770514 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-21af668e-aba0-4036-974c-f95c15ab86b4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:46.771493 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-21af668e-aba0-4036-974c-f95c15ab86b4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:46.772086 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-21af668e-aba0-4036-974c-f95c15ab86b4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:46.855278 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ff31ba22-fac5-4ea6-853f-931f41e62af6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:46.864294 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ff31ba22-fac5-4ea6-853f-931f41e62af6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:46.867772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ff31ba22-fac5-4ea6-853f-931f41e62af6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:46.868224 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ff31ba22-fac5-4ea6-853f-931f41e62af6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:46.869031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ff31ba22-fac5-4ea6-853f-931f41e62af6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:46.869472 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ff31ba22-fac5-4ea6-853f-931f41e62af6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:46.913300 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-21af668e-aba0-4036-974c-f95c15ab86b4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:46.915630 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:46.921949 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-21af668e-aba0-4036-974c-f95c15ab86b4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:46.923484 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-21af668e-aba0-4036-974c-f95c15ab86b4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:46.924679 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-21af668e-aba0-4036-974c-f95c15ab86b4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.167890 May 25 07:38:46.925751 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 128/267] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:46 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:38:46.931349 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ff31ba22-fac5-4ea6-853f-931f41e62af6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:46.939035 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ff31ba22-fac5-4ea6-853f-931f41e62af6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 200 len: 1308 microversion: 2.1 time: 0.087684 May 25 07:38:46.939669 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 140/268] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:46 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 1308 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:38:47.098271 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-20e6e4b8-76f5-41b8-8cfd-e74fb2b500ce tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:47.098890 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-20e6e4b8-76f5-41b8-8cfd-e74fb2b500ce tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:47.104939 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-20e6e4b8-76f5-41b8-8cfd-e74fb2b500ce tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:47.105388 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-20e6e4b8-76f5-41b8-8cfd-e74fb2b500ce tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:47.106150 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-20e6e4b8-76f5-41b8-8cfd-e74fb2b500ce tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:47.106586 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-20e6e4b8-76f5-41b8-8cfd-e74fb2b500ce tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:47.168346 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-20e6e4b8-76f5-41b8-8cfd-e74fb2b500ce tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c35b5419b14e288746992ca45065e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200c28fbfe02445e947d289ab4d36793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:47.176823 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-20e6e4b8-76f5-41b8-8cfd-e74fb2b500ce tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 200 len: 1219 microversion: 2.1 time: 0.082664 May 25 07:38:47.177559 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 129/269] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:47 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 1219 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:47.465359 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-690dd081-ada8-46ac-9178-b916adcf0c27 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:47.465990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-690dd081-ada8-46ac-9178-b916adcf0c27 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:47.472567 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-690dd081-ada8-46ac-9178-b916adcf0c27 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:47.473192 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-690dd081-ada8-46ac-9178-b916adcf0c27 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:47.473975 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-690dd081-ada8-46ac-9178-b916adcf0c27 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:47.474409 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-690dd081-ada8-46ac-9178-b916adcf0c27 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:47.612095 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-690dd081-ada8-46ac-9178-b916adcf0c27 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:47.620625 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-690dd081-ada8-46ac-9178-b916adcf0c27 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1371 microversion: 2.1 time: 0.159107 May 25 07:38:47.621194 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 141/270] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:47 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:47.944310 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-ccb0e1d5-5899-4755-90cf-51b2f9b0595e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:47.944988 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-ccb0e1d5-5899-4755-90cf-51b2f9b0595e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:47.952216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ccb0e1d5-5899-4755-90cf-51b2f9b0595e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:47.952879 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ccb0e1d5-5899-4755-90cf-51b2f9b0595e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:47.953640 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ccb0e1d5-5899-4755-90cf-51b2f9b0595e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:47.954070 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ccb0e1d5-5899-4755-90cf-51b2f9b0595e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:47.982371 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4f12e334-67a3-4b72-9ef8-0d89bdda9a95 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:47.983000 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4f12e334-67a3-4b72-9ef8-0d89bdda9a95 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:47.991602 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4f12e334-67a3-4b72-9ef8-0d89bdda9a95 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:47.992392 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4f12e334-67a3-4b72-9ef8-0d89bdda9a95 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:47.993834 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4f12e334-67a3-4b72-9ef8-0d89bdda9a95 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:47.994506 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4f12e334-67a3-4b72-9ef8-0d89bdda9a95 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:48.059085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4f12e334-67a3-4b72-9ef8-0d89bdda9a95 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:48.067628 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4f12e334-67a3-4b72-9ef8-0d89bdda9a95 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 200 len: 1296 microversion: 2.1 time: 0.105980 May 25 07:38:48.068220 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 142/271] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:47 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 1296 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:38:48.194771 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-09038b04-1b55-48e6-a800-6cef60cf75d1 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:48.195390 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-09038b04-1b55-48e6-a800-6cef60cf75d1 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:48.201438 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-09038b04-1b55-48e6-a800-6cef60cf75d1 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:48.201890 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-09038b04-1b55-48e6-a800-6cef60cf75d1 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:48.202725 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-09038b04-1b55-48e6-a800-6cef60cf75d1 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:48.203159 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-09038b04-1b55-48e6-a800-6cef60cf75d1 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:48.266832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-09038b04-1b55-48e6-a800-6cef60cf75d1 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c35b5419b14e288746992ca45065e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200c28fbfe02445e947d289ab4d36793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:48.275212 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-09038b04-1b55-48e6-a800-6cef60cf75d1 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 200 len: 1211 microversion: 2.1 time: 0.085236 May 25 07:38:48.275789 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 143/272] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:48 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 1211 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:38:48.412821 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-ccb0e1d5-5899-4755-90cf-51b2f9b0595e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:48.422253 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-ccb0e1d5-5899-4755-90cf-51b2f9b0595e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:48.424541 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-ccb0e1d5-5899-4755-90cf-51b2f9b0595e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:48.426443 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-ccb0e1d5-5899-4755-90cf-51b2f9b0595e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.486405 May 25 07:38:48.427262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 130/273] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:47 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:38:48.642650 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-406c8003-d7f5-4a29-9fe0-78e80fd8bbc2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:48.642650 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-406c8003-d7f5-4a29-9fe0-78e80fd8bbc2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:48.647227 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-406c8003-d7f5-4a29-9fe0-78e80fd8bbc2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:48.647688 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-406c8003-d7f5-4a29-9fe0-78e80fd8bbc2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:48.648464 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-406c8003-d7f5-4a29-9fe0-78e80fd8bbc2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:48.648929 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-406c8003-d7f5-4a29-9fe0-78e80fd8bbc2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:48.666041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-0aa9ea82-ebba-49bb-bf74-cc09d4ff726b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:38:48.672052 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0aa9ea82-ebba-49bb-bf74-cc09d4ff726b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:48.672778 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0aa9ea82-ebba-49bb-bf74-cc09d4ff726b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:48.749326 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-0aa9ea82-ebba-49bb-bf74-cc09d4ff726b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Going to try to stop instance {{(pid=124674) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 25 07:38:48.797328 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-406c8003-d7f5-4a29-9fe0-78e80fd8bbc2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:48.806276 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-406c8003-d7f5-4a29-9fe0-78e80fd8bbc2 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1563 microversion: 2.1 time: 0.170992 May 25 07:38:48.806862 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 144/274] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:48 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1563 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:48.823256 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-7baa7362-c0ba-47c2-9272-fc3ba98d9832 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:48.823759 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-7baa7362-c0ba-47c2-9272-fc3ba98d9832 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:48.829928 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7baa7362-c0ba-47c2-9272-fc3ba98d9832 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:48.830380 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7baa7362-c0ba-47c2-9272-fc3ba98d9832 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:48.831155 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7baa7362-c0ba-47c2-9272-fc3ba98d9832 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:48.831630 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7baa7362-c0ba-47c2-9272-fc3ba98d9832 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:48.919159 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-7baa7362-c0ba-47c2-9272-fc3ba98d9832 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.099773 May 25 07:38:48.920527 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 145/275] 10.222.0.24 () {58 vars in 1274 bytes} [Wed May 25 07:38:48 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196/os-interface => generated 285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:38:48.998873 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-0aa9ea82-ebba-49bb-bf74-cc09d4ff726b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "POST /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25/action" status: 202 len: 0 microversion: 2.1 time: 0.336002 May 25 07:38:48.999798 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 131/276] 10.222.0.24 () {60 vars in 1277 bytes} [Wed May 25 07:38:48 2022] POST /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25/action => generated 0 bytes in 338 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:38:49.013594 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-9211555e-eef5-417e-b526-225e5993054f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:49.014396 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-9211555e-eef5-417e-b526-225e5993054f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:49.025407 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9211555e-eef5-417e-b526-225e5993054f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:49.025873 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9211555e-eef5-417e-b526-225e5993054f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:49.026655 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9211555e-eef5-417e-b526-225e5993054f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:49.027127 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9211555e-eef5-417e-b526-225e5993054f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:49.087862 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-efaa95f5-f7a8-41eb-8f39-e93faf0e9efe tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:49.088589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-efaa95f5-f7a8-41eb-8f39-e93faf0e9efe tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:49.100001 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-efaa95f5-f7a8-41eb-8f39-e93faf0e9efe tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:49.101969 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-efaa95f5-f7a8-41eb-8f39-e93faf0e9efe tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:49.107076 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-efaa95f5-f7a8-41eb-8f39-e93faf0e9efe tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:49.107076 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-efaa95f5-f7a8-41eb-8f39-e93faf0e9efe tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:49.264630 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-9211555e-eef5-417e-b526-225e5993054f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:49.273924 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-9211555e-eef5-417e-b526-225e5993054f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1723 microversion: 2.1 time: 0.269766 May 25 07:38:49.283940 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 146/277] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:49 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:49.293355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-5f351923-26df-4793-83db-8d9682810564 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:49.294323 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-5f351923-26df-4793-83db-8d9682810564 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:49.300979 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5f351923-26df-4793-83db-8d9682810564 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:49.301578 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5f351923-26df-4793-83db-8d9682810564 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:49.307852 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5f351923-26df-4793-83db-8d9682810564 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:49.311717 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5f351923-26df-4793-83db-8d9682810564 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:49.387637 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-5f351923-26df-4793-83db-8d9682810564 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c35b5419b14e288746992ca45065e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200c28fbfe02445e947d289ab4d36793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:49.397944 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-5f351923-26df-4793-83db-8d9682810564 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 200 len: 1267 microversion: 2.1 time: 0.108945 May 25 07:38:49.399183 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 147/278] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:49 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 1267 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:49.447948 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a33ee663-38a9-44eb-a584-b5ffd6fc885a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:49.449457 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a33ee663-38a9-44eb-a584-b5ffd6fc885a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:49.474688 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a33ee663-38a9-44eb-a584-b5ffd6fc885a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:49.475496 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a33ee663-38a9-44eb-a584-b5ffd6fc885a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:49.476600 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a33ee663-38a9-44eb-a584-b5ffd6fc885a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:49.477259 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a33ee663-38a9-44eb-a584-b5ffd6fc885a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:49.485787 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-efaa95f5-f7a8-41eb-8f39-e93faf0e9efe tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:49.494435 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-efaa95f5-f7a8-41eb-8f39-e93faf0e9efe tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 200 len: 1364 microversion: 2.1 time: 0.410620 May 25 07:38:49.501614 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 132/279] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:49 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 1364 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:49.746472 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a33ee663-38a9-44eb-a584-b5ffd6fc885a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:49.757956 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a33ee663-38a9-44eb-a584-b5ffd6fc885a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:49.761049 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a33ee663-38a9-44eb-a584-b5ffd6fc885a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:49.763533 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a33ee663-38a9-44eb-a584-b5ffd6fc885a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.320363 May 25 07:38:49.764820 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 148/280] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:49 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:38:50.292101 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-22faf21a-f506-495c-9c4f-c6debd83c033 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:50.292948 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-22faf21a-f506-495c-9c4f-c6debd83c033 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:50.301454 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-22faf21a-f506-495c-9c4f-c6debd83c033 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:50.302355 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-22faf21a-f506-495c-9c4f-c6debd83c033 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:50.303658 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-22faf21a-f506-495c-9c4f-c6debd83c033 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:50.304615 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-22faf21a-f506-495c-9c4f-c6debd83c033 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:50.415483 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4178b1a4-caf0-4090-a2d3-c81ef926e7e6 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:50.416195 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4178b1a4-caf0-4090-a2d3-c81ef926e7e6 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:50.420307 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=5 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:50.436199 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4178b1a4-caf0-4090-a2d3-c81ef926e7e6 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:50.438412 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4178b1a4-caf0-4090-a2d3-c81ef926e7e6 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:50.439986 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4178b1a4-caf0-4090-a2d3-c81ef926e7e6 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:50.441897 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4178b1a4-caf0-4090-a2d3-c81ef926e7e6 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:50.486572 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=100 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:50.557311 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4178b1a4-caf0-4090-a2d3-c81ef926e7e6 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c35b5419b14e288746992ca45065e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200c28fbfe02445e947d289ab4d36793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:50.566322 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4178b1a4-caf0-4090-a2d3-c81ef926e7e6 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 200 len: 1273 microversion: 2.1 time: 0.154697 May 25 07:38:50.567232 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 149/281] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:50 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 1273 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:38:50.587183 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-d471b764-7deb-4abb-85c1-fd908c5273ca tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:50.588781 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-d471b764-7deb-4abb-85c1-fd908c5273ca tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:50.595478 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d471b764-7deb-4abb-85c1-fd908c5273ca tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:50.596244 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d471b764-7deb-4abb-85c1-fd908c5273ca tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:50.599344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d471b764-7deb-4abb-85c1-fd908c5273ca tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:50.600044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d471b764-7deb-4abb-85c1-fd908c5273ca tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:50.707733 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-22faf21a-f506-495c-9c4f-c6debd83c033 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:50.717376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-22faf21a-f506-495c-9c4f-c6debd83c033 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1723 microversion: 2.1 time: 0.429098 May 25 07:38:50.719194 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 133/282] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:50 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1723 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:50.783557 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-ae366fe9-61eb-4c4a-817d-69a6e1a925a6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:50.786571 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-ae366fe9-61eb-4c4a-817d-69a6e1a925a6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:50.794643 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ae366fe9-61eb-4c4a-817d-69a6e1a925a6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:50.795433 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ae366fe9-61eb-4c4a-817d-69a6e1a925a6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:50.796326 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ae366fe9-61eb-4c4a-817d-69a6e1a925a6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:50.796967 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ae366fe9-61eb-4c4a-817d-69a6e1a925a6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:50.844819 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d471b764-7deb-4abb-85c1-fd908c5273ca tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:50.853947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-d471b764-7deb-4abb-85c1-fd908c5273ca tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 200 len: 1364 microversion: 2.1 time: 0.270775 May 25 07:38:50.859305 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 150/283] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:50 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 1364 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:51.306932 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-ae366fe9-61eb-4c4a-817d-69a6e1a925a6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:51.313335 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-be216ce7-250b-4fc6-929d-246b5bc1aad6 req-dc7595d2-e29f-47e1-ba3c-9f075e2dc5b8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5ef563c-52c0-40b3-bdf3-dc51e5422196", "tag": "0747a8fb-24f2-4911-87f0-c806befeeab7"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:38:51.316653 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-ae366fe9-61eb-4c4a-817d-69a6e1a925a6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:51.318499 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-ae366fe9-61eb-4c4a-817d-69a6e1a925a6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:51.319790 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-ae366fe9-61eb-4c4a-817d-69a6e1a925a6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.540999 May 25 07:38:51.320454 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 134/284] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:50 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 542 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:38:51.327881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-be216ce7-250b-4fc6-929d-246b5bc1aad6 req-dc7595d2-e29f-47e1-ba3c-9f075e2dc5b8 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:51.328330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-be216ce7-250b-4fc6-929d-246b5bc1aad6 req-dc7595d2-e29f-47e1-ba3c-9f075e2dc5b8 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:51.343385 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-be216ce7-250b-4fc6-929d-246b5bc1aad6 req-dc7595d2-e29f-47e1-ba3c-9f075e2dc5b8 service nova] Creating event network-changed:0747a8fb-24f2-4911-87f0-c806befeeab7 for instance a5ef563c-52c0-40b3-bdf3-dc51e5422196 on hv-cinder-82549 May 25 07:38:51.350796 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-be216ce7-250b-4fc6-929d-246b5bc1aad6 req-dc7595d2-e29f-47e1-ba3c-9f075e2dc5b8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041631 May 25 07:38:51.351680 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 151/285] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:38:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:38:51.592755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-bfb00df4-445a-431b-8c8c-012d52476404 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:51.593955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-bfb00df4-445a-431b-8c8c-012d52476404 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:51.606038 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bfb00df4-445a-431b-8c8c-012d52476404 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:51.607550 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bfb00df4-445a-431b-8c8c-012d52476404 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:51.609579 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bfb00df4-445a-431b-8c8c-012d52476404 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:51.610479 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bfb00df4-445a-431b-8c8c-012d52476404 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:51.741214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ddca5bd3-4880-44ac-bb48-b934722fef3d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:51.742297 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ddca5bd3-4880-44ac-bb48-b934722fef3d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:51.751341 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ddca5bd3-4880-44ac-bb48-b934722fef3d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:51.751895 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ddca5bd3-4880-44ac-bb48-b934722fef3d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:51.752798 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ddca5bd3-4880-44ac-bb48-b934722fef3d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:51.754006 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ddca5bd3-4880-44ac-bb48-b934722fef3d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:51.763683 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-bfb00df4-445a-431b-8c8c-012d52476404 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c35b5419b14e288746992ca45065e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200c28fbfe02445e947d289ab4d36793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:51.777184 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-bfb00df4-445a-431b-8c8c-012d52476404 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 200 len: 1273 microversion: 2.1 time: 0.196472 May 25 07:38:51.777788 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 135/286] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:51 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 1273 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:51.872520 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-9c533821-4690-4b9d-8f31-514b6d9a9658 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:51.873351 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-9c533821-4690-4b9d-8f31-514b6d9a9658 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:51.888086 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9c533821-4690-4b9d-8f31-514b6d9a9658 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:51.888964 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9c533821-4690-4b9d-8f31-514b6d9a9658 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:51.889911 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9c533821-4690-4b9d-8f31-514b6d9a9658 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:51.890501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9c533821-4690-4b9d-8f31-514b6d9a9658 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:51.945333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ddca5bd3-4880-44ac-bb48-b934722fef3d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:51.954907 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ddca5bd3-4880-44ac-bb48-b934722fef3d tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1723 microversion: 2.1 time: 0.221553 May 25 07:38:51.955845 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 152/287] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:51 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1723 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:38:52.207755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9c533821-4690-4b9d-8f31-514b6d9a9658 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:52.216285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-9c533821-4690-4b9d-8f31-514b6d9a9658 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 200 len: 1364 microversion: 2.1 time: 0.347539 May 25 07:38:52.217068 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 136/288] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:51 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 1364 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:38:52.344279 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-0119c795-ed38-4283-aa7f-b94b32213d25 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:52.345033 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-0119c795-ed38-4283-aa7f-b94b32213d25 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:52.356226 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0119c795-ed38-4283-aa7f-b94b32213d25 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:52.361075 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0119c795-ed38-4283-aa7f-b94b32213d25 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:52.362055 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0119c795-ed38-4283-aa7f-b94b32213d25 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:52.362579 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0119c795-ed38-4283-aa7f-b94b32213d25 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:52.601064 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-0119c795-ed38-4283-aa7f-b94b32213d25 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:52.607981 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-0119c795-ed38-4283-aa7f-b94b32213d25 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:52.612363 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-0119c795-ed38-4283-aa7f-b94b32213d25 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:52.612363 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-0119c795-ed38-4283-aa7f-b94b32213d25 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.274479 May 25 07:38:52.612363 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 153/289] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:52 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:38:52.794731 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-a290a9f9-c3a8-436d-9c01-301f4fdb1853 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:52.795448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-a290a9f9-c3a8-436d-9c01-301f4fdb1853 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:52.802912 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a290a9f9-c3a8-436d-9c01-301f4fdb1853 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:52.803534 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a290a9f9-c3a8-436d-9c01-301f4fdb1853 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:52.804392 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a290a9f9-c3a8-436d-9c01-301f4fdb1853 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:52.804934 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a290a9f9-c3a8-436d-9c01-301f4fdb1853 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:52.980191 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a3d3bf98-7164-4db5-b163-d0a3109313d5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:52.980837 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a3d3bf98-7164-4db5-b163-d0a3109313d5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:52.991290 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a3d3bf98-7164-4db5-b163-d0a3109313d5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:52.991746 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a3d3bf98-7164-4db5-b163-d0a3109313d5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:52.992551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a3d3bf98-7164-4db5-b163-d0a3109313d5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:52.992996 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a3d3bf98-7164-4db5-b163-d0a3109313d5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:53.024106 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a290a9f9-c3a8-436d-9c01-301f4fdb1853 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c35b5419b14e288746992ca45065e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200c28fbfe02445e947d289ab4d36793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:53.032454 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-a290a9f9-c3a8-436d-9c01-301f4fdb1853 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 200 len: 1315 microversion: 2.1 time: 0.241577 May 25 07:38:53.041549 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 137/290] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:52 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 1315 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:53.152043 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a3d3bf98-7164-4db5-b163-d0a3109313d5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:53.160678 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a3d3bf98-7164-4db5-b163-d0a3109313d5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1723 microversion: 2.1 time: 0.188827 May 25 07:38:53.161246 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 154/291] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:52 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1723 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:53.234850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-8e1b693c-d031-43b3-9054-9103229643dd tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:53.235461 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-8e1b693c-d031-43b3-9054-9103229643dd tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:53.242250 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8e1b693c-d031-43b3-9054-9103229643dd tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:53.243399 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8e1b693c-d031-43b3-9054-9103229643dd tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:53.244214 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8e1b693c-d031-43b3-9054-9103229643dd tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:53.244698 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8e1b693c-d031-43b3-9054-9103229643dd tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:53.370139 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-283fff97-41f2-442e-abb3-560b84a26c32 req-b2f79299-779c-4019-a520-d730eb907f37 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f35115-ef0f-4ed9-b573-04bd28bed194", "tag": "14d0c437-f7e3-486f-860a-7d02ab291df3"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:38:53.381415 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-283fff97-41f2-442e-abb3-560b84a26c32 req-b2f79299-779c-4019-a520-d730eb907f37 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:53.382260 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-283fff97-41f2-442e-abb3-560b84a26c32 req-b2f79299-779c-4019-a520-d730eb907f37 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:53.397085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-283fff97-41f2-442e-abb3-560b84a26c32 req-b2f79299-779c-4019-a520-d730eb907f37 service nova] Creating event network-changed:14d0c437-f7e3-486f-860a-7d02ab291df3 for instance 93f35115-ef0f-4ed9-b573-04bd28bed194 on hv-cinder-82549 May 25 07:38:53.403201 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-283fff97-41f2-442e-abb3-560b84a26c32 req-b2f79299-779c-4019-a520-d730eb907f37 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037438 May 25 07:38:53.404418 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 155/292] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:38:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:38:53.467731 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-8e1b693c-d031-43b3-9054-9103229643dd tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:53.476059 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-8e1b693c-d031-43b3-9054-9103229643dd tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 200 len: 1364 microversion: 2.1 time: 0.245271 May 25 07:38:53.476869 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 138/293] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:53 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 1364 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:53.629838 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-42f2666b-0ad0-4135-8538-b07f731dc1ce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:53.630539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-42f2666b-0ad0-4135-8538-b07f731dc1ce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:53.638305 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-42f2666b-0ad0-4135-8538-b07f731dc1ce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:53.639180 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-42f2666b-0ad0-4135-8538-b07f731dc1ce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:53.640251 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-42f2666b-0ad0-4135-8538-b07f731dc1ce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:53.640791 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-42f2666b-0ad0-4135-8538-b07f731dc1ce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:53.782186 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-42f2666b-0ad0-4135-8538-b07f731dc1ce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:53.791986 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-42f2666b-0ad0-4135-8538-b07f731dc1ce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:53.793571 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-42f2666b-0ad0-4135-8538-b07f731dc1ce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:53.794794 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-42f2666b-0ad0-4135-8538-b07f731dc1ce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.169460 May 25 07:38:53.805520 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 156/294] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:53 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:38:54.049339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-47099c10-41b0-4d66-b375-21f46e0c1e0f tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:54.049949 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-47099c10-41b0-4d66-b375-21f46e0c1e0f tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:54.052530 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=2 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:54.057280 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-47099c10-41b0-4d66-b375-21f46e0c1e0f tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:54.057728 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-47099c10-41b0-4d66-b375-21f46e0c1e0f tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:54.058488 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-47099c10-41b0-4d66-b375-21f46e0c1e0f tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:54.058920 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-47099c10-41b0-4d66-b375-21f46e0c1e0f tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:54.178667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-59c15298-3be7-40e9-aedc-2f62db2387ac tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:54.180665 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-59c15298-3be7-40e9-aedc-2f62db2387ac tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:54.189294 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-59c15298-3be7-40e9-aedc-2f62db2387ac tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:54.189746 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-59c15298-3be7-40e9-aedc-2f62db2387ac tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:54.190522 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-59c15298-3be7-40e9-aedc-2f62db2387ac tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:54.191456 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-59c15298-3be7-40e9-aedc-2f62db2387ac tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:54.329692 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-59c15298-3be7-40e9-aedc-2f62db2387ac tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:54.331563 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-47099c10-41b0-4d66-b375-21f46e0c1e0f tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c35b5419b14e288746992ca45065e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200c28fbfe02445e947d289ab4d36793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:54.338065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-59c15298-3be7-40e9-aedc-2f62db2387ac tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1723 microversion: 2.1 time: 0.163768 May 25 07:38:54.349032 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-47099c10-41b0-4d66-b375-21f46e0c1e0f tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 200 len: 1315 microversion: 2.1 time: 0.295167 May 25 07:38:54.349032 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 139/295] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:54 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 1315 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:38:54.350580 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 157/296] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:54 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:38:54.494072 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c61144fc-cad6-4add-81b4-dc9eb33258a7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:54.494783 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c61144fc-cad6-4add-81b4-dc9eb33258a7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:54.501216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c61144fc-cad6-4add-81b4-dc9eb33258a7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:54.501736 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c61144fc-cad6-4add-81b4-dc9eb33258a7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:54.502579 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c61144fc-cad6-4add-81b4-dc9eb33258a7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:54.503092 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c61144fc-cad6-4add-81b4-dc9eb33258a7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:54.668885 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c61144fc-cad6-4add-81b4-dc9eb33258a7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:54.677314 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c61144fc-cad6-4add-81b4-dc9eb33258a7 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 200 len: 1364 microversion: 2.1 time: 0.187176 May 25 07:38:54.677887 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 140/297] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:54 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 1364 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:54.813808 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-bba73dd7-faa1-4ce6-af08-a6e2c49543cc tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:54.814427 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-bba73dd7-faa1-4ce6-af08-a6e2c49543cc tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:54.820772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-bba73dd7-faa1-4ce6-af08-a6e2c49543cc tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:54.821360 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-bba73dd7-faa1-4ce6-af08-a6e2c49543cc tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:54.822136 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-bba73dd7-faa1-4ce6-af08-a6e2c49543cc tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:54.822578 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-bba73dd7-faa1-4ce6-af08-a6e2c49543cc tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:54.955673 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-bba73dd7-faa1-4ce6-af08-a6e2c49543cc tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:54.964646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-bba73dd7-faa1-4ce6-af08-a6e2c49543cc tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:54.966161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-bba73dd7-faa1-4ce6-af08-a6e2c49543cc tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:54.967320 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-bba73dd7-faa1-4ce6-af08-a6e2c49543cc tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.157514 May 25 07:38:54.967871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 158/298] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:54 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:38:55.356776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-715bc530-99d7-47f1-bf13-205b36c54da7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:55.357960 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-68ae33da-cd5b-4b9b-a7a7-8d2c385b4004 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:55.358582 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-68ae33da-cd5b-4b9b-a7a7-8d2c385b4004 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:55.359052 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-715bc530-99d7-47f1-bf13-205b36c54da7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:55.361780 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:55.365883 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-68ae33da-cd5b-4b9b-a7a7-8d2c385b4004 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:55.366573 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-68ae33da-cd5b-4b9b-a7a7-8d2c385b4004 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:55.367575 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-68ae33da-cd5b-4b9b-a7a7-8d2c385b4004 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:55.368098 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-715bc530-99d7-47f1-bf13-205b36c54da7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:55.368504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-68ae33da-cd5b-4b9b-a7a7-8d2c385b4004 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:55.368616 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-715bc530-99d7-47f1-bf13-205b36c54da7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:55.369359 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-715bc530-99d7-47f1-bf13-205b36c54da7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:55.369796 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-715bc530-99d7-47f1-bf13-205b36c54da7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:55.520232 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-715bc530-99d7-47f1-bf13-205b36c54da7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:55.520894 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-68ae33da-cd5b-4b9b-a7a7-8d2c385b4004 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c35b5419b14e288746992ca45065e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200c28fbfe02445e947d289ab4d36793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:55.528503 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-68ae33da-cd5b-4b9b-a7a7-8d2c385b4004 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 200 len: 1315 microversion: 2.1 time: 0.174535 May 25 07:38:55.528793 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-715bc530-99d7-47f1-bf13-205b36c54da7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1723 microversion: 2.1 time: 0.176146 May 25 07:38:55.529088 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 159/299] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:55 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 1315 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:38:55.529393 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 141/300] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:55 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1723 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:55.534253 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-cebc4f9f-b337-4a15-bd8d-5081450b62fe req-4e1f3d80-f086-4aed-b519-1d8141ec34f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d093d4fa-b50b-40f9-af51-7236aeadccfd", "tag": "a6400c0b-243f-4dfe-92e5-459b82cb0f08"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:38:55.543012 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-cebc4f9f-b337-4a15-bd8d-5081450b62fe req-4e1f3d80-f086-4aed-b519-1d8141ec34f8 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:55.543462 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-cebc4f9f-b337-4a15-bd8d-5081450b62fe req-4e1f3d80-f086-4aed-b519-1d8141ec34f8 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:55.554850 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-cebc4f9f-b337-4a15-bd8d-5081450b62fe req-4e1f3d80-f086-4aed-b519-1d8141ec34f8 service nova] Creating event network-changed:a6400c0b-243f-4dfe-92e5-459b82cb0f08 for instance d093d4fa-b50b-40f9-af51-7236aeadccfd on hv-cinder-82549 May 25 07:38:55.565206 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-cebc4f9f-b337-4a15-bd8d-5081450b62fe req-4e1f3d80-f086-4aed-b519-1d8141ec34f8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028929 May 25 07:38:55.565206 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 160/301] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:38:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:38:55.694304 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-0cf70f90-d5e9-492c-810d-c6221b202add tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:55.694920 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-0cf70f90-d5e9-492c-810d-c6221b202add tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:55.701118 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0cf70f90-d5e9-492c-810d-c6221b202add tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:55.701737 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0cf70f90-d5e9-492c-810d-c6221b202add tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:55.702512 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0cf70f90-d5e9-492c-810d-c6221b202add tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:55.702950 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0cf70f90-d5e9-492c-810d-c6221b202add tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:55.983733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=2 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:55.985393 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=18 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:55.990656 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-19feccae-7513-44f3-ba4c-74be737baa4b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:55.991630 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-19feccae-7513-44f3-ba4c-74be737baa4b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:55.999219 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-19feccae-7513-44f3-ba4c-74be737baa4b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:55.999963 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-19feccae-7513-44f3-ba4c-74be737baa4b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:56.000873 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-19feccae-7513-44f3-ba4c-74be737baa4b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:56.001553 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-19feccae-7513-44f3-ba4c-74be737baa4b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:56.077839 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=8 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:56.169127 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-19feccae-7513-44f3-ba4c-74be737baa4b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:56.173565 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-19feccae-7513-44f3-ba4c-74be737baa4b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:56.175439 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-19feccae-7513-44f3-ba4c-74be737baa4b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:56.176849 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-19feccae-7513-44f3-ba4c-74be737baa4b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.194098 May 25 07:38:56.177404 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 161/302] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:55 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:38:56.198675 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-0cf70f90-d5e9-492c-810d-c6221b202add tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:56.206218 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-0cf70f90-d5e9-492c-810d-c6221b202add tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 200 len: 1364 microversion: 2.1 time: 0.515850 May 25 07:38:56.207514 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 142/303] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:55 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 1364 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:56.546235 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b3f4a9c7-3308-4eea-b96f-8adc09b775f0 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:56.547051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b3f4a9c7-3308-4eea-b96f-8adc09b775f0 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:56.548099 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-053071ab-5170-4c5a-98bb-9a06ed4641ef tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:56.549424 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-053071ab-5170-4c5a-98bb-9a06ed4641ef tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:56.555733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b3f4a9c7-3308-4eea-b96f-8adc09b775f0 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:56.555733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b3f4a9c7-3308-4eea-b96f-8adc09b775f0 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:56.556090 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b3f4a9c7-3308-4eea-b96f-8adc09b775f0 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:56.556470 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b3f4a9c7-3308-4eea-b96f-8adc09b775f0 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:56.560570 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-053071ab-5170-4c5a-98bb-9a06ed4641ef tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:56.561633 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-053071ab-5170-4c5a-98bb-9a06ed4641ef tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:56.563029 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-053071ab-5170-4c5a-98bb-9a06ed4641ef tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:56.564027 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-053071ab-5170-4c5a-98bb-9a06ed4641ef tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:56.723595 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-053071ab-5170-4c5a-98bb-9a06ed4641ef tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:56.726859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b3f4a9c7-3308-4eea-b96f-8adc09b775f0 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c35b5419b14e288746992ca45065e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200c28fbfe02445e947d289ab4d36793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:56.731564 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-053071ab-5170-4c5a-98bb-9a06ed4641ef tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1723 microversion: 2.1 time: 0.188635 May 25 07:38:56.732383 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 143/304] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:56 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1723 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:56.735076 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b3f4a9c7-3308-4eea-b96f-8adc09b775f0 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 200 len: 1315 microversion: 2.1 time: 0.193217 May 25 07:38:56.735703 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 162/305] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:56 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 1315 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:57.195863 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-6f07fa95-bf34-4a31-8651-bfa2174f3f9f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:57.196512 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-6f07fa95-bf34-4a31-8651-bfa2174f3f9f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:57.202876 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6f07fa95-bf34-4a31-8651-bfa2174f3f9f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:57.203329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6f07fa95-bf34-4a31-8651-bfa2174f3f9f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:57.204106 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6f07fa95-bf34-4a31-8651-bfa2174f3f9f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:57.204582 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6f07fa95-bf34-4a31-8651-bfa2174f3f9f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:57.222539 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:57.228871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-e7e6b652-5579-4318-aa95-eabec534de83 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:57.230511 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-e7e6b652-5579-4318-aa95-eabec534de83 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:57.240024 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e7e6b652-5579-4318-aa95-eabec534de83 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:57.240806 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e7e6b652-5579-4318-aa95-eabec534de83 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:57.242102 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e7e6b652-5579-4318-aa95-eabec534de83 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:57.242818 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e7e6b652-5579-4318-aa95-eabec534de83 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:57.394006 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-6f07fa95-bf34-4a31-8651-bfa2174f3f9f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:57.402894 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-6f07fa95-bf34-4a31-8651-bfa2174f3f9f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:57.411273 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-6f07fa95-bf34-4a31-8651-bfa2174f3f9f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:57.416324 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-6f07fa95-bf34-4a31-8651-bfa2174f3f9f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.220978 May 25 07:38:57.416324 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 144/306] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:57 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:38:57.426496 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-e7e6b652-5579-4318-aa95-eabec534de83 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:57.435348 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-e7e6b652-5579-4318-aa95-eabec534de83 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 200 len: 1364 microversion: 2.1 time: 0.214854 May 25 07:38:57.435941 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 163/307] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:57 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 1364 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:57.511336 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-bd79101f-c786-4bb4-af2f-ab4df3939565 req-6dc19a60-d7bd-4850-8c7b-e864d41661c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f35115-ef0f-4ed9-b573-04bd28bed194", "name": "network-vif-plugged", "status": "completed", "tag": "14d0c437-f7e3-486f-860a-7d02ab291df3"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:38:57.520889 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-bd79101f-c786-4bb4-af2f-ab4df3939565 req-6dc19a60-d7bd-4850-8c7b-e864d41661c5 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:57.521330 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-bd79101f-c786-4bb4-af2f-ab4df3939565 req-6dc19a60-d7bd-4850-8c7b-e864d41661c5 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:57.533425 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-bd79101f-c786-4bb4-af2f-ab4df3939565 req-6dc19a60-d7bd-4850-8c7b-e864d41661c5 service nova] Creating event network-vif-plugged:14d0c437-f7e3-486f-860a-7d02ab291df3 for instance 93f35115-ef0f-4ed9-b573-04bd28bed194 on hv-cinder-82549 May 25 07:38:57.539417 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-bd79101f-c786-4bb4-af2f-ab4df3939565 req-6dc19a60-d7bd-4850-8c7b-e864d41661c5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031672 May 25 07:38:57.540683 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 145/308] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:38:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:38:57.749104 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-14ac6ed7-b5cf-49f7-a037-b3914db6631f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:57.749786 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-14ac6ed7-b5cf-49f7-a037-b3914db6631f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:57.751677 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-f662c1d9-7b04-40a8-8765-79db61b13ded tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:57.753111 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-f662c1d9-7b04-40a8-8765-79db61b13ded tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:57.757995 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-14ac6ed7-b5cf-49f7-a037-b3914db6631f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:57.758465 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-14ac6ed7-b5cf-49f7-a037-b3914db6631f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:57.759252 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-14ac6ed7-b5cf-49f7-a037-b3914db6631f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:57.759697 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-14ac6ed7-b5cf-49f7-a037-b3914db6631f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:57.760120 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f662c1d9-7b04-40a8-8765-79db61b13ded tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:57.760675 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f662c1d9-7b04-40a8-8765-79db61b13ded tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:57.761507 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f662c1d9-7b04-40a8-8765-79db61b13ded tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:57.761949 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f662c1d9-7b04-40a8-8765-79db61b13ded tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:57.896048 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-14ac6ed7-b5cf-49f7-a037-b3914db6631f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:57.903640 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-f662c1d9-7b04-40a8-8765-79db61b13ded tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c35b5419b14e288746992ca45065e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200c28fbfe02445e947d289ab4d36793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:57.904782 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-14ac6ed7-b5cf-49f7-a037-b3914db6631f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1723 microversion: 2.1 time: 0.159602 May 25 07:38:57.905363 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 164/309] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:57 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:57.912454 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-f662c1d9-7b04-40a8-8765-79db61b13ded tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 200 len: 1315 microversion: 2.1 time: 0.164948 May 25 07:38:57.913001 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 146/310] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:57 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 1315 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:38:58.430903 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b1c937a5-5c66-4ac7-8065-087a05acc992 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:58.431517 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b1c937a5-5c66-4ac7-8065-087a05acc992 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:58.437610 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b1c937a5-5c66-4ac7-8065-087a05acc992 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:58.438060 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b1c937a5-5c66-4ac7-8065-087a05acc992 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:58.438822 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b1c937a5-5c66-4ac7-8065-087a05acc992 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:58.439258 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b1c937a5-5c66-4ac7-8065-087a05acc992 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:58.458575 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-814d2e2a-5578-4511-9b22-ac9a45d5801e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:58.459278 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-814d2e2a-5578-4511-9b22-ac9a45d5801e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:58.465753 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-814d2e2a-5578-4511-9b22-ac9a45d5801e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:58.466196 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-814d2e2a-5578-4511-9b22-ac9a45d5801e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:58.466954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-814d2e2a-5578-4511-9b22-ac9a45d5801e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:58.467384 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-814d2e2a-5578-4511-9b22-ac9a45d5801e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:58.570136 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b1c937a5-5c66-4ac7-8065-087a05acc992 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:58.578384 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b1c937a5-5c66-4ac7-8065-087a05acc992 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:58.580210 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b1c937a5-5c66-4ac7-8065-087a05acc992 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:58.582593 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b1c937a5-5c66-4ac7-8065-087a05acc992 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1743 microversion: 2.20 time: 0.154870 May 25 07:38:58.593384 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 165/311] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:58 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1743 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:38:58.610503 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-814d2e2a-5578-4511-9b22-ac9a45d5801e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:58.618004 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-814d2e2a-5578-4511-9b22-ac9a45d5801e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 200 len: 1364 microversion: 2.1 time: 0.164391 May 25 07:38:58.618573 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 147/312] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:58 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 1364 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:38:58.922765 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-3e3d1892-0642-4cd1-937e-7ed32e7b01de tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:58.923443 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-3e3d1892-0642-4cd1-937e-7ed32e7b01de tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:58.928932 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-9e5721f2-8682-4085-bf8e-fae670882bac tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:58.929576 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-9e5721f2-8682-4085-bf8e-fae670882bac tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:58.930601 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3e3d1892-0642-4cd1-937e-7ed32e7b01de tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:58.931060 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3e3d1892-0642-4cd1-937e-7ed32e7b01de tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:58.932019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3e3d1892-0642-4cd1-937e-7ed32e7b01de tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:58.932467 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3e3d1892-0642-4cd1-937e-7ed32e7b01de tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:58.935776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9e5721f2-8682-4085-bf8e-fae670882bac tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:58.936231 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9e5721f2-8682-4085-bf8e-fae670882bac tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:58.937036 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9e5721f2-8682-4085-bf8e-fae670882bac tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:58.937471 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9e5721f2-8682-4085-bf8e-fae670882bac tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:59.070653 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-3e3d1892-0642-4cd1-937e-7ed32e7b01de tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:59.071315 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9e5721f2-8682-4085-bf8e-fae670882bac tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c35b5419b14e288746992ca45065e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200c28fbfe02445e947d289ab4d36793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:59.079462 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-3e3d1892-0642-4cd1-937e-7ed32e7b01de tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1723 microversion: 2.1 time: 0.160566 May 25 07:38:59.080052 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-9e5721f2-8682-4085-bf8e-fae670882bac tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 200 len: 1315 microversion: 2.1 time: 0.155737 May 25 07:38:59.084638 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 166/313] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:58 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1723 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:38:59.084804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 148/314] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:58 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:38:59.585238 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-cd824abb-c4bb-4263-ace2-0e7f73c2eab7 req-5d7cec3a-8aa5-4ff8-8101-9a2aaabdd44d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d093d4fa-b50b-40f9-af51-7236aeadccfd", "name": "network-vif-plugged", "status": "completed", "tag": "a6400c0b-243f-4dfe-92e5-459b82cb0f08"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:38:59.594167 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-cd824abb-c4bb-4263-ace2-0e7f73c2eab7 req-5d7cec3a-8aa5-4ff8-8101-9a2aaabdd44d service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:59.594613 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-cd824abb-c4bb-4263-ace2-0e7f73c2eab7 req-5d7cec3a-8aa5-4ff8-8101-9a2aaabdd44d service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:59.607584 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-866f3ff6-bbb8-4acd-8f35-835b32129b13 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:59.607584 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-866f3ff6-bbb8-4acd-8f35-835b32129b13 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:59.609981 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-866f3ff6-bbb8-4acd-8f35-835b32129b13 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:59.610422 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-866f3ff6-bbb8-4acd-8f35-835b32129b13 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:59.611183 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-866f3ff6-bbb8-4acd-8f35-835b32129b13 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:59.611611 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-866f3ff6-bbb8-4acd-8f35-835b32129b13 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:59.627071 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-cd824abb-c4bb-4263-ace2-0e7f73c2eab7 req-5d7cec3a-8aa5-4ff8-8101-9a2aaabdd44d service nova] Creating event network-vif-plugged:a6400c0b-243f-4dfe-92e5-459b82cb0f08 for instance d093d4fa-b50b-40f9-af51-7236aeadccfd on hv-cinder-82549 May 25 07:38:59.632994 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-cd824abb-c4bb-4263-ace2-0e7f73c2eab7 req-5d7cec3a-8aa5-4ff8-8101-9a2aaabdd44d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.051961 May 25 07:38:59.633596 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 167/315] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:38:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:38:59.639854 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-fb10d383-6d0f-4fcb-a053-db66f3ff1d12 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:38:59.640571 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-fb10d383-6d0f-4fcb-a053-db66f3ff1d12 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:38:59.647264 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fb10d383-6d0f-4fcb-a053-db66f3ff1d12 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:59.648138 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fb10d383-6d0f-4fcb-a053-db66f3ff1d12 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:59.648488 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fb10d383-6d0f-4fcb-a053-db66f3ff1d12 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:38:59.648967 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fb10d383-6d0f-4fcb-a053-db66f3ff1d12 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:38:59.756285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-866f3ff6-bbb8-4acd-8f35-835b32129b13 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:59.764998 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-866f3ff6-bbb8-4acd-8f35-835b32129b13 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:59.766765 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-866f3ff6-bbb8-4acd-8f35-835b32129b13 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:59.767939 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-866f3ff6-bbb8-4acd-8f35-835b32129b13 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1743 microversion: 2.20 time: 0.169223 May 25 07:38:59.777350 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 149/316] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:38:59 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1743 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:38:59.806176 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-fb10d383-6d0f-4fcb-a053-db66f3ff1d12 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:38:59.808603 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=100 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:38:59.814415 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-fb10d383-6d0f-4fcb-a053-db66f3ff1d12 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 200 len: 1364 microversion: 2.1 time: 0.179516 May 25 07:38:59.814980 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 168/317] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:38:59 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 1364 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:00.097731 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-76ff248e-52fa-4594-9c40-68c9251f7a92 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:00.099312 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-76ff248e-52fa-4594-9c40-68c9251f7a92 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:00.100419 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-234dc28a-d9a7-49a7-a3d2-1fe75eb262c1 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:00.101345 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-234dc28a-d9a7-49a7-a3d2-1fe75eb262c1 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:00.106606 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-76ff248e-52fa-4594-9c40-68c9251f7a92 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:00.107537 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-76ff248e-52fa-4594-9c40-68c9251f7a92 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:00.108504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-76ff248e-52fa-4594-9c40-68c9251f7a92 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:00.109229 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-76ff248e-52fa-4594-9c40-68c9251f7a92 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:00.112149 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-234dc28a-d9a7-49a7-a3d2-1fe75eb262c1 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:00.112721 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-234dc28a-d9a7-49a7-a3d2-1fe75eb262c1 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:00.114245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-234dc28a-d9a7-49a7-a3d2-1fe75eb262c1 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:00.114745 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-234dc28a-d9a7-49a7-a3d2-1fe75eb262c1 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:00.262571 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-76ff248e-52fa-4594-9c40-68c9251f7a92 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c35b5419b14e288746992ca45065e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200c28fbfe02445e947d289ab4d36793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:00.271079 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-76ff248e-52fa-4594-9c40-68c9251f7a92 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 200 len: 1315 microversion: 2.1 time: 0.177620 May 25 07:39:00.271650 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 150/318] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:00 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:39:00.281971 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-234dc28a-d9a7-49a7-a3d2-1fe75eb262c1 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:00.290023 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-234dc28a-d9a7-49a7-a3d2-1fe75eb262c1 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1723 microversion: 2.1 time: 0.196153 May 25 07:39:00.290589 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 169/319] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:00 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1723 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:00.787667 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-9bf06047-8038-4374-9aa0-9aef617eb138 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:00.788298 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-9bf06047-8038-4374-9aa0-9aef617eb138 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:00.794756 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9bf06047-8038-4374-9aa0-9aef617eb138 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:00.795204 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9bf06047-8038-4374-9aa0-9aef617eb138 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:00.795956 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9bf06047-8038-4374-9aa0-9aef617eb138 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:00.796462 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9bf06047-8038-4374-9aa0-9aef617eb138 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:00.838342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a998b7f8-cc80-4185-903b-dc6eab908cab tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:00.839030 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a998b7f8-cc80-4185-903b-dc6eab908cab tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:00.852916 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a998b7f8-cc80-4185-903b-dc6eab908cab tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:00.852916 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a998b7f8-cc80-4185-903b-dc6eab908cab tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:00.852916 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a998b7f8-cc80-4185-903b-dc6eab908cab tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:00.852916 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a998b7f8-cc80-4185-903b-dc6eab908cab tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:00.949108 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9bf06047-8038-4374-9aa0-9aef617eb138 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:00.962712 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9bf06047-8038-4374-9aa0-9aef617eb138 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:00.964656 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9bf06047-8038-4374-9aa0-9aef617eb138 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:00.965899 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-9bf06047-8038-4374-9aa0-9aef617eb138 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1738 microversion: 2.20 time: 0.183508 May 25 07:39:00.966470 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 151/320] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:00 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1738 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:01.000556 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a998b7f8-cc80-4185-903b-dc6eab908cab tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:01.009131 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a998b7f8-cc80-4185-903b-dc6eab908cab tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 200 len: 1555 microversion: 2.1 time: 0.174658 May 25 07:39:01.009698 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 170/321] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:00 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 1555 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:39:01.025872 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-fea2a803-72e8-47e5-9800-7b687e1ca803 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:01.026365 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-fea2a803-72e8-47e5-9800-7b687e1ca803 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:01.032325 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fea2a803-72e8-47e5-9800-7b687e1ca803 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:01.032815 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fea2a803-72e8-47e5-9800-7b687e1ca803 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:01.033581 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fea2a803-72e8-47e5-9800-7b687e1ca803 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:01.034027 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fea2a803-72e8-47e5-9800-7b687e1ca803 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:01.114107 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-fea2a803-72e8-47e5-9800-7b687e1ca803 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092110 May 25 07:39:01.114832 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 152/322] 10.222.0.24 () {58 vars in 1274 bytes} [Wed May 25 07:39:01 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:39:01.287451 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4f1fcff4-307a-428e-affb-f725f3184745 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:01.288068 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4f1fcff4-307a-428e-affb-f725f3184745 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:01.295472 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4f1fcff4-307a-428e-affb-f725f3184745 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:01.296148 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4f1fcff4-307a-428e-affb-f725f3184745 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:01.297216 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4f1fcff4-307a-428e-affb-f725f3184745 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:01.297823 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4f1fcff4-307a-428e-affb-f725f3184745 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:01.309067 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-b7b7b4b2-8f19-4e5a-85d4-55d5374a0c39 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:01.309910 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-b7b7b4b2-8f19-4e5a-85d4-55d5374a0c39 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:01.319892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b7b7b4b2-8f19-4e5a-85d4-55d5374a0c39 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:01.322597 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b7b7b4b2-8f19-4e5a-85d4-55d5374a0c39 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:01.324444 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b7b7b4b2-8f19-4e5a-85d4-55d5374a0c39 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:01.325857 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b7b7b4b2-8f19-4e5a-85d4-55d5374a0c39 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:01.496004 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4f1fcff4-307a-428e-affb-f725f3184745 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c35b5419b14e288746992ca45065e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200c28fbfe02445e947d289ab4d36793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:01.505554 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4f1fcff4-307a-428e-affb-f725f3184745 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 200 len: 1315 microversion: 2.1 time: 0.222172 May 25 07:39:01.506640 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 171/323] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:01 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:01.648509 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-d41fa04c-968a-4f94-9ca6-b5f87891e283 req-bd32b8a6-e7b9-49d5-a053-15eba3ec10a0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d360341-449d-4b49-8b66-a02a969171fd", "name": "network-vif-plugged", "status": "completed", "tag": "5b9220dd-eeaa-4ea1-a0cd-e54c1dbfe455"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:39:01.655507 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-b7b7b4b2-8f19-4e5a-85d4-55d5374a0c39 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:01.664710 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-d41fa04c-968a-4f94-9ca6-b5f87891e283 req-bd32b8a6-e7b9-49d5-a053-15eba3ec10a0 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:01.665559 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-d41fa04c-968a-4f94-9ca6-b5f87891e283 req-bd32b8a6-e7b9-49d5-a053-15eba3ec10a0 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:01.671604 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-b7b7b4b2-8f19-4e5a-85d4-55d5374a0c39 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1700 microversion: 2.1 time: 0.367742 May 25 07:39:01.672516 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 153/324] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:01 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1700 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:39:01.692215 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-9d05d04b-c526-463b-bdff-27d30d265c79 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:39:01.699087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9d05d04b-c526-463b-bdff-27d30d265c79 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:01.699536 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9d05d04b-c526-463b-bdff-27d30d265c79 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:01.714513 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-d41fa04c-968a-4f94-9ca6-b5f87891e283 req-bd32b8a6-e7b9-49d5-a053-15eba3ec10a0 service nova] Creating event network-vif-plugged:5b9220dd-eeaa-4ea1-a0cd-e54c1dbfe455 for instance 6d360341-449d-4b49-8b66-a02a969171fd on hv-cinder-82549 May 25 07:39:01.723056 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-d41fa04c-968a-4f94-9ca6-b5f87891e283 req-bd32b8a6-e7b9-49d5-a053-15eba3ec10a0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.078079 May 25 07:39:01.725019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 172/325] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:39:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:39:01.730458 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-9d05d04b-c526-463b-bdff-27d30d265c79 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Going to try to start instance {{(pid=124674) start /opt/stack/nova/nova/compute/api.py:2730}} May 25 07:39:01.948631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-9d05d04b-c526-463b-bdff-27d30d265c79 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "POST /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25/action" status: 202 len: 0 microversion: 2.1 time: 0.260170 May 25 07:39:01.950107 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 154/326] 10.222.0.24 () {60 vars in 1277 bytes} [Wed May 25 07:39:01 2022] POST /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25/action => generated 0 bytes in 262 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:39:01.959252 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ebfa464c-504f-4bba-b814-98cf3268cf0c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:01.960489 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ebfa464c-504f-4bba-b814-98cf3268cf0c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:01.967613 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ebfa464c-504f-4bba-b814-98cf3268cf0c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:01.968067 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ebfa464c-504f-4bba-b814-98cf3268cf0c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:01.969070 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ebfa464c-504f-4bba-b814-98cf3268cf0c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:01.969851 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ebfa464c-504f-4bba-b814-98cf3268cf0c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:01.989613 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-5aa53304-b99b-4f2f-9727-08e86b1acda7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:01.998738 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-5aa53304-b99b-4f2f-9727-08e86b1acda7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:02.015911 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5aa53304-b99b-4f2f-9727-08e86b1acda7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:02.016424 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5aa53304-b99b-4f2f-9727-08e86b1acda7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:02.017237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5aa53304-b99b-4f2f-9727-08e86b1acda7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:02.020107 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5aa53304-b99b-4f2f-9727-08e86b1acda7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:02.237426 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ebfa464c-504f-4bba-b814-98cf3268cf0c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:02.250330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ebfa464c-504f-4bba-b814-98cf3268cf0c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1709 microversion: 2.1 time: 0.293617 May 25 07:39:02.254226 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 173/327] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:01 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1709 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:02.295677 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-5aa53304-b99b-4f2f-9727-08e86b1acda7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:02.305013 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-5aa53304-b99b-4f2f-9727-08e86b1acda7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:02.306829 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-5aa53304-b99b-4f2f-9727-08e86b1acda7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:02.308755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-5aa53304-b99b-4f2f-9727-08e86b1acda7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1738 microversion: 2.20 time: 0.323243 May 25 07:39:02.319875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 155/328] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:01 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1738 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:39:02.524614 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4a5797ce-799f-4a5e-a184-6bf794576043 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:02.525944 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4a5797ce-799f-4a5e-a184-6bf794576043 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:02.533263 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4a5797ce-799f-4a5e-a184-6bf794576043 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:02.534000 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4a5797ce-799f-4a5e-a184-6bf794576043 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:02.536024 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4a5797ce-799f-4a5e-a184-6bf794576043 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:02.537111 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4a5797ce-799f-4a5e-a184-6bf794576043 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:02.631838 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-e1752f16-f94c-4181-aa9d-2d849b9e3180 req-977a0291-ccd4-4ad5-a351-ade8c01401b6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "93f35115-ef0f-4ed9-b573-04bd28bed194", "tag": "14d0c437-f7e3-486f-860a-7d02ab291df3"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:39:02.653516 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-e1752f16-f94c-4181-aa9d-2d849b9e3180 req-977a0291-ccd4-4ad5-a351-ade8c01401b6 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:02.656139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-e1752f16-f94c-4181-aa9d-2d849b9e3180 req-977a0291-ccd4-4ad5-a351-ade8c01401b6 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:02.735947 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-e1752f16-f94c-4181-aa9d-2d849b9e3180 req-977a0291-ccd4-4ad5-a351-ade8c01401b6 service nova] Creating event network-changed:14d0c437-f7e3-486f-860a-7d02ab291df3 for instance 93f35115-ef0f-4ed9-b573-04bd28bed194 on hv-cinder-82549 May 25 07:39:02.754242 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-e1752f16-f94c-4181-aa9d-2d849b9e3180 req-977a0291-ccd4-4ad5-a351-ade8c01401b6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.124805 May 25 07:39:02.757940 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 156/329] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:39:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:39:02.869820 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4a5797ce-799f-4a5e-a184-6bf794576043 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c35b5419b14e288746992ca45065e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200c28fbfe02445e947d289ab4d36793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:02.878150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4a5797ce-799f-4a5e-a184-6bf794576043 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 200 len: 1465 microversion: 2.1 time: 0.359574 May 25 07:39:02.880675 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 174/330] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:02 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 1465 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:02.936850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-58602e67-05ea-40a5-a631-8dba853457d8 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:02.937852 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-58602e67-05ea-40a5-a631-8dba853457d8 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:02.945892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-58602e67-05ea-40a5-a631-8dba853457d8 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:02.946634 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-58602e67-05ea-40a5-a631-8dba853457d8 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:02.947607 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-58602e67-05ea-40a5-a631-8dba853457d8 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:02.948186 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-58602e67-05ea-40a5-a631-8dba853457d8 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:02.992762 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-58602e67-05ea-40a5-a631-8dba853457d8 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Going to try to terminate instance {{(pid=124674) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:39:03.274400 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a0dcf580-c32c-4df5-ab8b-1999122cd457 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:03.275321 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a0dcf580-c32c-4df5-ab8b-1999122cd457 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:03.283989 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a0dcf580-c32c-4df5-ab8b-1999122cd457 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:03.284792 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a0dcf580-c32c-4df5-ab8b-1999122cd457 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:03.285947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a0dcf580-c32c-4df5-ab8b-1999122cd457 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:03.286614 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a0dcf580-c32c-4df5-ab8b-1999122cd457 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:03.492925 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-58602e67-05ea-40a5-a631-8dba853457d8 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 204 len: 0 microversion: 2.1 time: 0.560425 May 25 07:39:03.494051 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 157/331] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:39:02 2022] DELETE /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 0 bytes in 562 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 07:39:03.499617 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-670c7b0e-7a27-4c01-aa3b-2392ec3f03cf tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:03.500536 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-670c7b0e-7a27-4c01-aa3b-2392ec3f03cf tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:03.518045 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-670c7b0e-7a27-4c01-aa3b-2392ec3f03cf tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:03.518786 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-670c7b0e-7a27-4c01-aa3b-2392ec3f03cf tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:03.524408 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-670c7b0e-7a27-4c01-aa3b-2392ec3f03cf tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:03.525141 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-670c7b0e-7a27-4c01-aa3b-2392ec3f03cf tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:03.551474 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a0dcf580-c32c-4df5-ab8b-1999122cd457 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:03.566605 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a0dcf580-c32c-4df5-ab8b-1999122cd457 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1709 microversion: 2.1 time: 0.300860 May 25 07:39:03.574158 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 175/332] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:03 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1709 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:39:03.602783 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-cea63c6e-cf76-4f0a-ba4e-d79b12999f85 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:03.604363 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-cea63c6e-cf76-4f0a-ba4e-d79b12999f85 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:03.613177 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cea63c6e-cf76-4f0a-ba4e-d79b12999f85 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:03.613944 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cea63c6e-cf76-4f0a-ba4e-d79b12999f85 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:03.614953 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cea63c6e-cf76-4f0a-ba4e-d79b12999f85 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:03.615614 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cea63c6e-cf76-4f0a-ba4e-d79b12999f85 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:03.747836 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-670c7b0e-7a27-4c01-aa3b-2392ec3f03cf tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:03.765695 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-670c7b0e-7a27-4c01-aa3b-2392ec3f03cf tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:03.767504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-670c7b0e-7a27-4c01-aa3b-2392ec3f03cf tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:03.768923 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-670c7b0e-7a27-4c01-aa3b-2392ec3f03cf tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1738 microversion: 2.20 time: 0.273673 May 25 07:39:03.770225 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 158/333] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:03 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1738 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:03.781341 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-cea63c6e-cf76-4f0a-ba4e-d79b12999f85 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c35b5419b14e288746992ca45065e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200c28fbfe02445e947d289ab4d36793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:03.789584 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-cea63c6e-cf76-4f0a-ba4e-d79b12999f85 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 200 len: 1471 microversion: 2.1 time: 0.213127 May 25 07:39:03.791887 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 176/334] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:03 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 1471 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:04.594535 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-ba08b249-b304-401c-9c24-12b412b3c9ba tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:04.597787 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-ba08b249-b304-401c-9c24-12b412b3c9ba tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:04.603607 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ba08b249-b304-401c-9c24-12b412b3c9ba tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:04.604305 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ba08b249-b304-401c-9c24-12b412b3c9ba tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:04.605290 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ba08b249-b304-401c-9c24-12b412b3c9ba tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:04.605945 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ba08b249-b304-401c-9c24-12b412b3c9ba tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:04.765832 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-ba08b249-b304-401c-9c24-12b412b3c9ba tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:04.777302 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-ba08b249-b304-401c-9c24-12b412b3c9ba tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1709 microversion: 2.1 time: 0.197931 May 25 07:39:04.792266 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-7abbd43e-854b-4056-8781-6d066fce83c7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:04.797849 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 159/335] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:04 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1709 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:04.797997 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-7abbd43e-854b-4056-8781-6d066fce83c7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:04.802456 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7abbd43e-854b-4056-8781-6d066fce83c7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:04.802922 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7abbd43e-854b-4056-8781-6d066fce83c7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:04.803775 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7abbd43e-854b-4056-8781-6d066fce83c7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:04.804167 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7abbd43e-854b-4056-8781-6d066fce83c7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:04.821581 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-4ffeb608-30be-4c39-b7e5-49a051225825 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:04.822456 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-4ffeb608-30be-4c39-b7e5-49a051225825 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:04.829611 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4ffeb608-30be-4c39-b7e5-49a051225825 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:04.830532 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4ffeb608-30be-4c39-b7e5-49a051225825 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:04.832360 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4ffeb608-30be-4c39-b7e5-49a051225825 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:04.832975 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4ffeb608-30be-4c39-b7e5-49a051225825 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:04.856733 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:39:04.966025 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-7abbd43e-854b-4056-8781-6d066fce83c7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:04.976559 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-7abbd43e-854b-4056-8781-6d066fce83c7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:04.978547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-7abbd43e-854b-4056-8781-6d066fce83c7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:04.979949 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-7abbd43e-854b-4056-8781-6d066fce83c7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1738 microversion: 2.20 time: 0.191563 May 25 07:39:04.991113 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 177/336] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:04 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1738 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:05.362075 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-4ffeb608-30be-4c39-b7e5-49a051225825 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c35b5419b14e288746992ca45065e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200c28fbfe02445e947d289ab4d36793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:05.372352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-4ffeb608-30be-4c39-b7e5-49a051225825 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 200 len: 1471 microversion: 2.1 time: 0.555932 May 25 07:39:05.382637 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 160/337] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:04 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 1471 bytes in 558 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:39:05.799077 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-f7729755-d1e4-4e4f-b299-b2a57c6d54af tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:05.799713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-f7729755-d1e4-4e4f-b299-b2a57c6d54af tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:05.807354 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f7729755-d1e4-4e4f-b299-b2a57c6d54af tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:05.808050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f7729755-d1e4-4e4f-b299-b2a57c6d54af tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:05.809076 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f7729755-d1e4-4e4f-b299-b2a57c6d54af tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:05.809581 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f7729755-d1e4-4e4f-b299-b2a57c6d54af tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:05.954166 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-f7729755-d1e4-4e4f-b299-b2a57c6d54af tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:05.963122 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-f7729755-d1e4-4e4f-b299-b2a57c6d54af tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1709 microversion: 2.1 time: 0.167853 May 25 07:39:05.964247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 178/338] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:05 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1709 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:05.999088 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-8126e77e-b6c2-455b-a408-1de935b5a4b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:05.999790 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-8126e77e-b6c2-455b-a408-1de935b5a4b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:06.006530 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8126e77e-b6c2-455b-a408-1de935b5a4b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:06.007076 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8126e77e-b6c2-455b-a408-1de935b5a4b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:06.007992 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8126e77e-b6c2-455b-a408-1de935b5a4b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:06.008543 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8126e77e-b6c2-455b-a408-1de935b5a4b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:06.150532 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-8126e77e-b6c2-455b-a408-1de935b5a4b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:06.160934 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-8126e77e-b6c2-455b-a408-1de935b5a4b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:06.162706 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-8126e77e-b6c2-455b-a408-1de935b5a4b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:06.164062 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-8126e77e-b6c2-455b-a408-1de935b5a4b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1738 microversion: 2.20 time: 0.169065 May 25 07:39:06.175440 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 161/339] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:05 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:06.390639 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8c7f0ab4-ebb1-4e98-add2-61182d19ff62 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:06.391565 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-8c7f0ab4-ebb1-4e98-add2-61182d19ff62 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:06.398167 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8c7f0ab4-ebb1-4e98-add2-61182d19ff62 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:06.398554 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8c7f0ab4-ebb1-4e98-add2-61182d19ff62 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:06.399324 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8c7f0ab4-ebb1-4e98-add2-61182d19ff62 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:06.399763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8c7f0ab4-ebb1-4e98-add2-61182d19ff62 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:06.543505 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-8c7f0ab4-ebb1-4e98-add2-61182d19ff62 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c35b5419b14e288746992ca45065e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200c28fbfe02445e947d289ab4d36793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:06.552323 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-8c7f0ab4-ebb1-4e98-add2-61182d19ff62 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 200 len: 1471 microversion: 2.1 time: 0.165875 May 25 07:39:06.553145 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 179/340] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:06 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 1471 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:06.980700 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-4ccedf22-f44a-47f4-a37e-ad4717f9202a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:06.981592 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-4ccedf22-f44a-47f4-a37e-ad4717f9202a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:07.004809 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4ccedf22-f44a-47f4-a37e-ad4717f9202a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:07.011392 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4ccedf22-f44a-47f4-a37e-ad4717f9202a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:07.011392 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4ccedf22-f44a-47f4-a37e-ad4717f9202a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:07.011392 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4ccedf22-f44a-47f4-a37e-ad4717f9202a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:07.157081 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-4ccedf22-f44a-47f4-a37e-ad4717f9202a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:07.166547 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-4ccedf22-f44a-47f4-a37e-ad4717f9202a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1709 microversion: 2.1 time: 0.189624 May 25 07:39:07.169577 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 162/341] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:06 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1709 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:07.183765 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a9ce89d3-73f2-4946-b3e4-8b8285c0942a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:07.187823 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a9ce89d3-73f2-4946-b3e4-8b8285c0942a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:07.193874 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a9ce89d3-73f2-4946-b3e4-8b8285c0942a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:07.194430 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a9ce89d3-73f2-4946-b3e4-8b8285c0942a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:07.195301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a9ce89d3-73f2-4946-b3e4-8b8285c0942a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:07.195818 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a9ce89d3-73f2-4946-b3e4-8b8285c0942a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:07.345766 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a9ce89d3-73f2-4946-b3e4-8b8285c0942a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:07.354913 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a9ce89d3-73f2-4946-b3e4-8b8285c0942a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:07.356539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a9ce89d3-73f2-4946-b3e4-8b8285c0942a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:07.358393 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a9ce89d3-73f2-4946-b3e4-8b8285c0942a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1738 microversion: 2.20 time: 0.179384 May 25 07:39:07.359626 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 180/342] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:07 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1738 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:07.570283 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-2b08c72f-0558-4e74-b52e-131975809ff6 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:07.571414 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-2b08c72f-0558-4e74-b52e-131975809ff6 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:07.578216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2b08c72f-0558-4e74-b52e-131975809ff6 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:07.578984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2b08c72f-0558-4e74-b52e-131975809ff6 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:07.579762 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2b08c72f-0558-4e74-b52e-131975809ff6 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:07.580233 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2b08c72f-0558-4e74-b52e-131975809ff6 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:07.744178 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-2b08c72f-0558-4e74-b52e-131975809ff6 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c35b5419b14e288746992ca45065e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200c28fbfe02445e947d289ab4d36793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:07.753323 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-2b08c72f-0558-4e74-b52e-131975809ff6 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 200 len: 1471 microversion: 2.1 time: 0.187655 May 25 07:39:07.755327 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 163/343] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:07 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 1471 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:39:08.189196 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-08caba3b-bc00-4668-8c18-cd3217ff44a9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:08.193030 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-08caba3b-bc00-4668-8c18-cd3217ff44a9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:08.201308 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-08caba3b-bc00-4668-8c18-cd3217ff44a9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:08.202133 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-08caba3b-bc00-4668-8c18-cd3217ff44a9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:08.203259 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-08caba3b-bc00-4668-8c18-cd3217ff44a9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:08.203795 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-08caba3b-bc00-4668-8c18-cd3217ff44a9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:08.379083 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d750bec4-78e1-48a2-b188-4715b239636c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:08.380801 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d750bec4-78e1-48a2-b188-4715b239636c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:08.388620 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d750bec4-78e1-48a2-b188-4715b239636c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:08.389368 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d750bec4-78e1-48a2-b188-4715b239636c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:08.390319 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d750bec4-78e1-48a2-b188-4715b239636c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:08.390760 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d750bec4-78e1-48a2-b188-4715b239636c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:08.469233 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-08caba3b-bc00-4668-8c18-cd3217ff44a9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:08.479163 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-08caba3b-bc00-4668-8c18-cd3217ff44a9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1709 microversion: 2.1 time: 0.296529 May 25 07:39:08.491057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 181/344] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:08 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1709 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:08.550011 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d750bec4-78e1-48a2-b188-4715b239636c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:08.560465 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d750bec4-78e1-48a2-b188-4715b239636c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:08.562639 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d750bec4-78e1-48a2-b188-4715b239636c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:08.564015 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d750bec4-78e1-48a2-b188-4715b239636c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1738 microversion: 2.20 time: 0.189538 May 25 07:39:08.564730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 164/345] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:08 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1738 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:08.771555 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-af0cab51-3685-4811-8a4b-91297db296be tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:08.772176 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-af0cab51-3685-4811-8a4b-91297db296be tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:08.778142 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-af0cab51-3685-4811-8a4b-91297db296be tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:08.778588 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-af0cab51-3685-4811-8a4b-91297db296be tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:08.779902 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-af0cab51-3685-4811-8a4b-91297db296be tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:08.779902 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-af0cab51-3685-4811-8a4b-91297db296be tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:08.915214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-af0cab51-3685-4811-8a4b-91297db296be tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c35b5419b14e288746992ca45065e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200c28fbfe02445e947d289ab4d36793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:08.922786 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-af0cab51-3685-4811-8a4b-91297db296be tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 200 len: 1471 microversion: 2.1 time: 0.155360 May 25 07:39:08.923364 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 182/346] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:08 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 1471 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:09.059346 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-52b3637d-53cc-4b0c-ae62-6e1765374f02 req-d4ce9bb4-b8b7-4526-a46f-7d4a5653ebd4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d093d4fa-b50b-40f9-af51-7236aeadccfd", "name": "network-vif-deleted", "tag": "a6400c0b-243f-4dfe-92e5-459b82cb0f08"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:39:09.069983 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-52b3637d-53cc-4b0c-ae62-6e1765374f02 req-d4ce9bb4-b8b7-4526-a46f-7d4a5653ebd4 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:09.070775 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-52b3637d-53cc-4b0c-ae62-6e1765374f02 req-d4ce9bb4-b8b7-4526-a46f-7d4a5653ebd4 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:09.094268 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-52b3637d-53cc-4b0c-ae62-6e1765374f02 req-d4ce9bb4-b8b7-4526-a46f-7d4a5653ebd4 service nova] Creating event network-vif-deleted:a6400c0b-243f-4dfe-92e5-459b82cb0f08 for instance d093d4fa-b50b-40f9-af51-7236aeadccfd on hv-cinder-82549 May 25 07:39:09.105234 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-52b3637d-53cc-4b0c-ae62-6e1765374f02 req-d4ce9bb4-b8b7-4526-a46f-7d4a5653ebd4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059070 May 25 07:39:09.106525 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 165/347] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:39:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:39:09.498096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-755808ed-d6d0-459a-858b-3fce089b4d41 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:09.499356 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-755808ed-d6d0-459a-858b-3fce089b4d41 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:09.506460 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-755808ed-d6d0-459a-858b-3fce089b4d41 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:09.506912 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-755808ed-d6d0-459a-858b-3fce089b4d41 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:09.507686 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-755808ed-d6d0-459a-858b-3fce089b4d41 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:09.508124 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-755808ed-d6d0-459a-858b-3fce089b4d41 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:09.585802 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-6a4bf194-61e0-4af1-a932-14ae2c5bb4b3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:09.587289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-6a4bf194-61e0-4af1-a932-14ae2c5bb4b3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:09.603113 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6a4bf194-61e0-4af1-a932-14ae2c5bb4b3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:09.604819 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6a4bf194-61e0-4af1-a932-14ae2c5bb4b3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:09.606151 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6a4bf194-61e0-4af1-a932-14ae2c5bb4b3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:09.606817 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6a4bf194-61e0-4af1-a932-14ae2c5bb4b3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:09.710395 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-755808ed-d6d0-459a-858b-3fce089b4d41 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:09.719760 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-755808ed-d6d0-459a-858b-3fce089b4d41 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1709 microversion: 2.1 time: 0.225527 May 25 07:39:09.720547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 183/348] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:09 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1709 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:09.834949 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-6a4bf194-61e0-4af1-a932-14ae2c5bb4b3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:09.845095 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-6a4bf194-61e0-4af1-a932-14ae2c5bb4b3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:09.846857 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-6a4bf194-61e0-4af1-a932-14ae2c5bb4b3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:09.848227 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-6a4bf194-61e0-4af1-a932-14ae2c5bb4b3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1738 microversion: 2.20 time: 0.268001 May 25 07:39:09.849298 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 166/349] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:09 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1738 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:09.939525 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-835aeaea-c142-4a8d-8f1f-c3aa0888485b tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:09.940137 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-835aeaea-c142-4a8d-8f1f-c3aa0888485b tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:09.947373 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-835aeaea-c142-4a8d-8f1f-c3aa0888485b tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:09.948068 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-835aeaea-c142-4a8d-8f1f-c3aa0888485b tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:09.948910 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-835aeaea-c142-4a8d-8f1f-c3aa0888485b tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:09.949519 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-835aeaea-c142-4a8d-8f1f-c3aa0888485b tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:09.983756 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-835aeaea-c142-4a8d-8f1f-c3aa0888485b tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:09.984217 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-835aeaea-c142-4a8d-8f1f-c3aa0888485b tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:09.988600 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.objects.instance [None req-835aeaea-c142-4a8d-8f1f-c3aa0888485b tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lazy-loading 'fault' on Instance uuid d093d4fa-b50b-40f9-af51-7236aeadccfd {{(pid=124675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:39:10.031886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-835aeaea-c142-4a8d-8f1f-c3aa0888485b tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c2c35b5419b14e288746992ca45065e5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '200c28fbfe02445e947d289ab4d36793', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:10.038887 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-835aeaea-c142-4a8d-8f1f-c3aa0888485b tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 200 len: 1305 microversion: 2.1 time: 0.103082 May 25 07:39:10.041326 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 184/350] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:09 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 1305 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:10.738538 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-490e62e3-7dd4-4e63-a4b6-f8cfac0bc6a1 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:10.739285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-490e62e3-7dd4-4e63-a4b6-f8cfac0bc6a1 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:10.745919 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-490e62e3-7dd4-4e63-a4b6-f8cfac0bc6a1 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:10.746369 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-490e62e3-7dd4-4e63-a4b6-f8cfac0bc6a1 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:10.747793 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-490e62e3-7dd4-4e63-a4b6-f8cfac0bc6a1 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:10.748143 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-490e62e3-7dd4-4e63-a4b6-f8cfac0bc6a1 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:10.867562 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-d56e4e9f-f5cc-4e1b-9ce1-d5e371596125 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:10.868943 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-d56e4e9f-f5cc-4e1b-9ce1-d5e371596125 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:10.876066 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d56e4e9f-f5cc-4e1b-9ce1-d5e371596125 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:10.876892 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d56e4e9f-f5cc-4e1b-9ce1-d5e371596125 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:10.877882 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d56e4e9f-f5cc-4e1b-9ce1-d5e371596125 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:10.878610 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d56e4e9f-f5cc-4e1b-9ce1-d5e371596125 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:10.918683 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-490e62e3-7dd4-4e63-a4b6-f8cfac0bc6a1 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:10.929116 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-490e62e3-7dd4-4e63-a4b6-f8cfac0bc6a1 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1713 microversion: 2.1 time: 0.194769 May 25 07:39:10.929708 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 167/351] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:10 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1713 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:39:11.026272 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d56e4e9f-f5cc-4e1b-9ce1-d5e371596125 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:11.028621 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=100 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:39:11.036130 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d56e4e9f-f5cc-4e1b-9ce1-d5e371596125 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:11.038039 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d56e4e9f-f5cc-4e1b-9ce1-d5e371596125 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:11.039427 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-d56e4e9f-f5cc-4e1b-9ce1-d5e371596125 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1738 microversion: 2.20 time: 0.176180 May 25 07:39:11.039986 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 185/352] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:10 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1738 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:39:11.061190 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-db7d1a16-fdc9-466e-bd37-e89e72b83fd8 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:11.065374 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-db7d1a16-fdc9-466e-bd37-e89e72b83fd8 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] [instance: d093d4fa-b50b-40f9-af51-7236aeadccfd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:11.078473 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-db7d1a16-fdc9-466e-bd37-e89e72b83fd8 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:11.078927 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-db7d1a16-fdc9-466e-bd37-e89e72b83fd8 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:11.079713 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-db7d1a16-fdc9-466e-bd37-e89e72b83fd8 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:11.080152 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-db7d1a16-fdc9-466e-bd37-e89e72b83fd8 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-db7d1a16-fdc9-466e-bd37-e89e72b83fd8 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] HTTP exception thrown: Instance d093d4fa-b50b-40f9-af51-7236aeadccfd could not be found. May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-db7d1a16-fdc9-466e-bd37-e89e72b83fd8 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Request method failure captured: May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd HTTP/1.1 May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijd0DQSLolPsNXAkn6hzxkFdXzE7TXhnKgo0UZpn7dGUbdxWY6TBaYVmMjV8xreeBj_ES7beQidXZKO-0FKgWyN_Uuq_AKpYazlBNdT_YOWldVp7FkElnQ9hTEzNoUwbkXP9wpEXEhLPQtXsLG0vq8XcRH8lkOCRyIMkk-vJ-mzHktxE May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: 200c28fbfe02445e947d289ab4d36793 May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-VolumesNegativeTest-118865852 May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:39:11.105629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:39:11.107360 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/200c28fbfe02445e947d289ab4d36793"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/200c28fbfe02445e947d289ab4d36793"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_200c28fbfe02445e947d289ab4d36793", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/200c28fbfe02445e947d289ab4d36793"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:39:11.107360 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-VolumesNegativeTest-118865852 May 25 07:39:11.107360 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: 200c28fbfe02445e947d289ab4d36793 May 25 07:39:11.107360 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-VolumesNegativeTest-118865852 May 25 07:39:11.107360 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-VolumesNegativeTest-118865852-project May 25 07:39:11.107360 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:39:11.107360 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:39:11.107360 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: c2c35b5419b14e288746992ca45065e5 May 25 07:39:11.107360 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-VolumesNegativeTest-118865852-project May 25 07:39:11.107360 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:39:11.107360 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Instance d093d4fa-b50b-40f9-af51-7236aeadccfd could not be found. May 25 07:39:11.107360 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': 'd093d4fa-b50b-40f9-af51-7236aeadccfd'} May 25 07:39:11.108361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:39:11.108361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:39:11.108361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:39:11.108361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:39:11.108361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:39:11.108361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:39:11.108361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:39:11.108361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:39:11.108361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:39:11.108361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:39:11.108361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d093d4fa-b50b-40f9-af51-7236aeadccfd could not be found. May 25 07:39:11.108361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:39:11.108361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:39:11.108361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:39:11.108361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:39:11.108361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:39:11.108361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:39:11.108361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:39:11.108361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:39:11.108361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:39:11.109669 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:39:11.109669 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:39:11.109669 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:39:11.109669 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:39:11.109669 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:39:11.109669 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:39:11.109669 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:39:11.109669 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d093d4fa-b50b-40f9-af51-7236aeadccfd could not be found. May 25 07:39:11.109669 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:39:11.109669 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:39:11.109669 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:39:11.109669 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:39:11.109669 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:39:11.109669 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:39:11.109669 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:39:11.109669 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:39:11.109669 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d093d4fa-b50b-40f9-af51-7236aeadccfd could not be found. May 25 07:39:11.109669 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:39:11.112283 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-db7d1a16-fdc9-466e-bd37-e89e72b83fd8 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] Returning 404 to user: Instance d093d4fa-b50b-40f9-af51-7236aeadccfd could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:39:11.112283 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-db7d1a16-fdc9-466e-bd37-e89e72b83fd8 tempest-VolumesNegativeTest-118865852 tempest-VolumesNegativeTest-118865852-project] 10.222.0.24 "GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd" status: 404 len: 111 microversion: 2.1 time: 0.047180 May 25 07:39:11.117487 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 168/353] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:11 2022] GET /compute/v2.1/servers/d093d4fa-b50b-40f9-af51-7236aeadccfd => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:39:12.058322 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-de6f6975-05cb-4978-a7dd-1b27e33ad757 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:12.058939 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-de6f6975-05cb-4978-a7dd-1b27e33ad757 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:12.065582 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-de6f6975-05cb-4978-a7dd-1b27e33ad757 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:12.067806 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-de6f6975-05cb-4978-a7dd-1b27e33ad757 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:12.067806 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-de6f6975-05cb-4978-a7dd-1b27e33ad757 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:12.067806 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-de6f6975-05cb-4978-a7dd-1b27e33ad757 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:12.225800 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-de6f6975-05cb-4978-a7dd-1b27e33ad757 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:12.234733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-de6f6975-05cb-4978-a7dd-1b27e33ad757 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:12.236903 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-de6f6975-05cb-4978-a7dd-1b27e33ad757 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:12.237457 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-de6f6975-05cb-4978-a7dd-1b27e33ad757 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1738 microversion: 2.20 time: 0.183401 May 25 07:39:12.259824 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 186/354] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:12 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1738 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:13.260728 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-b7fcf403-f08e-40ac-a965-39e23431cbf8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:13.261925 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-b7fcf403-f08e-40ac-a965-39e23431cbf8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:13.273747 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b7fcf403-f08e-40ac-a965-39e23431cbf8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:13.274501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b7fcf403-f08e-40ac-a965-39e23431cbf8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:13.275572 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b7fcf403-f08e-40ac-a965-39e23431cbf8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:13.276961 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b7fcf403-f08e-40ac-a965-39e23431cbf8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:13.463034 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-b7fcf403-f08e-40ac-a965-39e23431cbf8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:13.472407 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-b7fcf403-f08e-40ac-a965-39e23431cbf8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:13.474189 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-b7fcf403-f08e-40ac-a965-39e23431cbf8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:13.475468 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-b7fcf403-f08e-40ac-a965-39e23431cbf8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1738 microversion: 2.20 time: 0.224161 May 25 07:39:13.476175 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 169/355] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:13 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1738 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:14.494306 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-2de570df-d0e2-4446-a836-0473eb641921 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:14.495013 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-2de570df-d0e2-4446-a836-0473eb641921 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:14.501500 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2de570df-d0e2-4446-a836-0473eb641921 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:14.501958 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2de570df-d0e2-4446-a836-0473eb641921 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:14.502733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2de570df-d0e2-4446-a836-0473eb641921 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:14.503237 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2de570df-d0e2-4446-a836-0473eb641921 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:14.633842 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-2de570df-d0e2-4446-a836-0473eb641921 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:14.641774 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-2de570df-d0e2-4446-a836-0473eb641921 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:14.643286 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-2de570df-d0e2-4446-a836-0473eb641921 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:14.644576 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-2de570df-d0e2-4446-a836-0473eb641921 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1738 microversion: 2.20 time: 0.154190 May 25 07:39:14.645133 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 187/356] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:14 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1738 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:15.664319 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-a2ccb3a6-1d31-4b93-8e29-ee71f71bfdb2 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:15.665337 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-a2ccb3a6-1d31-4b93-8e29-ee71f71bfdb2 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:15.671709 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a2ccb3a6-1d31-4b93-8e29-ee71f71bfdb2 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:15.672137 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a2ccb3a6-1d31-4b93-8e29-ee71f71bfdb2 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:15.672937 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a2ccb3a6-1d31-4b93-8e29-ee71f71bfdb2 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:15.673371 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a2ccb3a6-1d31-4b93-8e29-ee71f71bfdb2 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:15.807538 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a2ccb3a6-1d31-4b93-8e29-ee71f71bfdb2 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:15.815529 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a2ccb3a6-1d31-4b93-8e29-ee71f71bfdb2 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:15.817090 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a2ccb3a6-1d31-4b93-8e29-ee71f71bfdb2 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:15.818262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-a2ccb3a6-1d31-4b93-8e29-ee71f71bfdb2 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1720 microversion: 2.20 time: 0.159756 May 25 07:39:15.818833 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 170/357] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:15 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1720 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:16.836653 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-249cf3f5-98f3-492e-ac34-2081dd081bce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:16.837305 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-249cf3f5-98f3-492e-ac34-2081dd081bce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:16.843685 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-249cf3f5-98f3-492e-ac34-2081dd081bce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:16.844156 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-249cf3f5-98f3-492e-ac34-2081dd081bce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:16.844948 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-249cf3f5-98f3-492e-ac34-2081dd081bce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:16.845456 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-249cf3f5-98f3-492e-ac34-2081dd081bce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:16.984162 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-249cf3f5-98f3-492e-ac34-2081dd081bce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:16.998303 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-249cf3f5-98f3-492e-ac34-2081dd081bce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:16.998303 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-249cf3f5-98f3-492e-ac34-2081dd081bce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:16.998303 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-249cf3f5-98f3-492e-ac34-2081dd081bce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1720 microversion: 2.20 time: 0.165150 May 25 07:39:17.004355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 188/358] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:16 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:18.016962 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-48cc529a-8ba3-455e-baa7-e750069e83b5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:18.017533 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-48cc529a-8ba3-455e-baa7-e750069e83b5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:18.024759 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-48cc529a-8ba3-455e-baa7-e750069e83b5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:18.025210 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-48cc529a-8ba3-455e-baa7-e750069e83b5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:18.025976 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-48cc529a-8ba3-455e-baa7-e750069e83b5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:18.026413 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-48cc529a-8ba3-455e-baa7-e750069e83b5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:18.164235 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-48cc529a-8ba3-455e-baa7-e750069e83b5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:18.173432 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-48cc529a-8ba3-455e-baa7-e750069e83b5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:18.174977 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-48cc529a-8ba3-455e-baa7-e750069e83b5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:18.176246 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-48cc529a-8ba3-455e-baa7-e750069e83b5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1723 microversion: 2.20 time: 0.163275 May 25 07:39:18.176832 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 171/359] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:18 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:18.194660 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-cb39742a-3390-495c-ab0e-f2c52525c47c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6def8d01-32a2-48ac-a658-08ff6b93491c"}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:39:18.195789 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-cb39742a-3390-495c-ab0e-f2c52525c47c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:18.203767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cb39742a-3390-495c-ab0e-f2c52525c47c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:18.204354 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cb39742a-3390-495c-ab0e-f2c52525c47c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:18.205984 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cb39742a-3390-495c-ab0e-f2c52525c47c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:18.206425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cb39742a-3390-495c-ab0e-f2c52525c47c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:19.320343 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-cb39742a-3390-495c-ab0e-f2c52525c47c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "POST /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.130308 May 25 07:39:19.321045 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 189/360] 10.222.0.24 () {62 vars in 1363 bytes} [Wed May 25 07:39:18 2022] POST /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd/os-volume_attachments => generated 188 bytes in 1132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 07:39:19.454379 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-34d0cadb-aa44-4081-9948-ad8d8fb62f75 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:39:19.454943 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-34d0cadb-aa44-4081-9948-ad8d8fb62f75 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:19.461949 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-34d0cadb-aa44-4081-9948-ad8d8fb62f75 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:19.462409 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-34d0cadb-aa44-4081-9948-ad8d8fb62f75 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:19.463164 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-34d0cadb-aa44-4081-9948-ad8d8fb62f75 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:19.463601 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-34d0cadb-aa44-4081-9948-ad8d8fb62f75 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:19.740173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-34d0cadb-aa44-4081-9948-ad8d8fb62f75 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "POST /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd/action" status: 202 len: 0 microversion: 2.20 time: 0.289620 May 25 07:39:19.741159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 172/361] 10.222.0.24 () {62 vars in 1318 bytes} [Wed May 25 07:39:19 2022] POST /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd/action => generated 0 bytes in 291 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 07:39:19.756331 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-d9925e90-a408-44e4-86a4-15436e9f4d8b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:19.756982 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-d9925e90-a408-44e4-86a4-15436e9f4d8b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:19.767035 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d9925e90-a408-44e4-86a4-15436e9f4d8b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:19.767537 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d9925e90-a408-44e4-86a4-15436e9f4d8b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:19.768534 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d9925e90-a408-44e4-86a4-15436e9f4d8b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:19.769193 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d9925e90-a408-44e4-86a4-15436e9f4d8b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:19.902148 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d9925e90-a408-44e4-86a4-15436e9f4d8b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:19.911162 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d9925e90-a408-44e4-86a4-15436e9f4d8b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:19.912846 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d9925e90-a408-44e4-86a4-15436e9f4d8b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:19.917033 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-d9925e90-a408-44e4-86a4-15436e9f4d8b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1749 microversion: 2.20 time: 0.162364 May 25 07:39:19.917033 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 190/362] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:19 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:20.177545 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-c541a475-a1eb-4352-a821-f684ae409eb5 req-3c2d0196-b720-47c0-93b7-bbe180b20cff service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d360341-449d-4b49-8b66-a02a969171fd", "name": "network-vif-unplugged", "status": "completed", "tag": "5b9220dd-eeaa-4ea1-a0cd-e54c1dbfe455"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:39:20.186092 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-c541a475-a1eb-4352-a821-f684ae409eb5 req-3c2d0196-b720-47c0-93b7-bbe180b20cff service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:20.186647 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-c541a475-a1eb-4352-a821-f684ae409eb5 req-3c2d0196-b720-47c0-93b7-bbe180b20cff service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:20.198313 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.compute.server_external_events [req-c541a475-a1eb-4352-a821-f684ae409eb5 req-3c2d0196-b720-47c0-93b7-bbe180b20cff service nova] Unable to find a host for instance 6d360341-449d-4b49-8b66-a02a969171fd. Dropping event network-vif-unplugged {{(pid=124674) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 25 07:39:20.199274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-c541a475-a1eb-4352-a821-f684ae409eb5 req-3c2d0196-b720-47c0-93b7-bbe180b20cff service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026988 May 25 07:39:20.203943 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 173/363] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:39:20 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 32 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 25 07:39:20.933797 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ef342ca8-fafd-414d-a8e9-8c021107705d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:20.934521 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ef342ca8-fafd-414d-a8e9-8c021107705d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:20.937011 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=86 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:39:20.941998 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ef342ca8-fafd-414d-a8e9-8c021107705d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:20.942740 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ef342ca8-fafd-414d-a8e9-8c021107705d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:20.943470 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ef342ca8-fafd-414d-a8e9-8c021107705d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:20.943909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ef342ca8-fafd-414d-a8e9-8c021107705d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:21.147187 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ef342ca8-fafd-414d-a8e9-8c021107705d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:21.155541 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ef342ca8-fafd-414d-a8e9-8c021107705d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:21.157135 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ef342ca8-fafd-414d-a8e9-8c021107705d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:21.158385 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ef342ca8-fafd-414d-a8e9-8c021107705d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1749 microversion: 2.20 time: 0.228834 May 25 07:39:21.158943 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 191/364] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:20 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1749 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:22.178237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-a29c151d-2a1d-4fc8-8de2-11856302c396 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:22.178850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-a29c151d-2a1d-4fc8-8de2-11856302c396 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:22.185299 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a29c151d-2a1d-4fc8-8de2-11856302c396 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:22.185759 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a29c151d-2a1d-4fc8-8de2-11856302c396 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:22.186526 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a29c151d-2a1d-4fc8-8de2-11856302c396 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:22.187028 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a29c151d-2a1d-4fc8-8de2-11856302c396 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:22.331373 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a29c151d-2a1d-4fc8-8de2-11856302c396 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:22.340762 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a29c151d-2a1d-4fc8-8de2-11856302c396 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:22.342441 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a29c151d-2a1d-4fc8-8de2-11856302c396 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:22.343718 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-a29c151d-2a1d-4fc8-8de2-11856302c396 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1751 microversion: 2.20 time: 0.170242 May 25 07:39:22.344352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 174/365] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:22 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1751 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:23.366961 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-07e54eca-1d79-469c-98b7-d2a93fb3fded tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:23.367760 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-07e54eca-1d79-469c-98b7-d2a93fb3fded tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:23.374672 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-07e54eca-1d79-469c-98b7-d2a93fb3fded tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:23.375355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-07e54eca-1d79-469c-98b7-d2a93fb3fded tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:23.376140 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-07e54eca-1d79-469c-98b7-d2a93fb3fded tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:23.376643 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-07e54eca-1d79-469c-98b7-d2a93fb3fded tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:23.558548 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-07e54eca-1d79-469c-98b7-d2a93fb3fded tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:23.568098 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-07e54eca-1d79-469c-98b7-d2a93fb3fded tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:23.569789 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-07e54eca-1d79-469c-98b7-d2a93fb3fded tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:23.571256 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-07e54eca-1d79-469c-98b7-d2a93fb3fded tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1751 microversion: 2.20 time: 0.211605 May 25 07:39:23.582833 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 192/366] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:23 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1751 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:24.592774 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7928c12b-9801-4329-84db-ce1001ef548f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:24.594142 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-7928c12b-9801-4329-84db-ce1001ef548f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:24.602896 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7928c12b-9801-4329-84db-ce1001ef548f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:24.603534 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7928c12b-9801-4329-84db-ce1001ef548f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:24.604679 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7928c12b-9801-4329-84db-ce1001ef548f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:24.605269 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7928c12b-9801-4329-84db-ce1001ef548f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:24.755616 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7928c12b-9801-4329-84db-ce1001ef548f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:24.764683 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7928c12b-9801-4329-84db-ce1001ef548f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:24.766317 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7928c12b-9801-4329-84db-ce1001ef548f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:24.767654 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-7928c12b-9801-4329-84db-ce1001ef548f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.180940 May 25 07:39:24.768360 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 175/367] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:24 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:25.790410 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-77696b43-4cbc-44e8-8fc7-bc20a4e43143 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:25.791754 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-77696b43-4cbc-44e8-8fc7-bc20a4e43143 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:25.798962 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-77696b43-4cbc-44e8-8fc7-bc20a4e43143 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:25.799620 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-77696b43-4cbc-44e8-8fc7-bc20a4e43143 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:25.801119 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-77696b43-4cbc-44e8-8fc7-bc20a4e43143 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:25.801766 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-77696b43-4cbc-44e8-8fc7-bc20a4e43143 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:25.990792 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-77696b43-4cbc-44e8-8fc7-bc20a4e43143 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:26.008140 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-77696b43-4cbc-44e8-8fc7-bc20a4e43143 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:26.010447 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-77696b43-4cbc-44e8-8fc7-bc20a4e43143 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:26.012087 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-77696b43-4cbc-44e8-8fc7-bc20a4e43143 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.228998 May 25 07:39:26.013204 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 193/368] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:25 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:27.031611 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-51c2832a-b650-4efc-9eca-476700974aa8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:27.034247 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-51c2832a-b650-4efc-9eca-476700974aa8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:27.043602 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:39:27.053057 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-51c2832a-b650-4efc-9eca-476700974aa8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:27.054120 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-51c2832a-b650-4efc-9eca-476700974aa8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:27.057499 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-51c2832a-b650-4efc-9eca-476700974aa8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:27.058753 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-51c2832a-b650-4efc-9eca-476700974aa8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:27.297979 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-51c2832a-b650-4efc-9eca-476700974aa8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:27.310829 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-51c2832a-b650-4efc-9eca-476700974aa8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:27.321517 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-51c2832a-b650-4efc-9eca-476700974aa8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:27.323130 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-51c2832a-b650-4efc-9eca-476700974aa8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.295474 May 25 07:39:27.328586 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 176/369] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:27 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:28.351272 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-9d74685d-71d0-4c41-8076-1a30847863e8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:28.352428 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-9d74685d-71d0-4c41-8076-1a30847863e8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:28.359999 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9d74685d-71d0-4c41-8076-1a30847863e8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:28.360456 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9d74685d-71d0-4c41-8076-1a30847863e8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:28.361265 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9d74685d-71d0-4c41-8076-1a30847863e8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:28.361708 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9d74685d-71d0-4c41-8076-1a30847863e8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:28.576525 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-9d74685d-71d0-4c41-8076-1a30847863e8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:28.593615 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-9d74685d-71d0-4c41-8076-1a30847863e8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:28.595719 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-9d74685d-71d0-4c41-8076-1a30847863e8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:28.597814 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-9d74685d-71d0-4c41-8076-1a30847863e8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.252329 May 25 07:39:28.599073 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 194/370] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:28 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:29.631406 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-978e5dca-4fcb-4b25-b7d8-1a2e3b4a851d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:29.632728 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-978e5dca-4fcb-4b25-b7d8-1a2e3b4a851d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:29.642139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-978e5dca-4fcb-4b25-b7d8-1a2e3b4a851d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:29.642599 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-978e5dca-4fcb-4b25-b7d8-1a2e3b4a851d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:29.644088 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-978e5dca-4fcb-4b25-b7d8-1a2e3b4a851d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:29.645221 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-978e5dca-4fcb-4b25-b7d8-1a2e3b4a851d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:29.920611 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-978e5dca-4fcb-4b25-b7d8-1a2e3b4a851d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:29.928855 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:39:29.932067 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-978e5dca-4fcb-4b25-b7d8-1a2e3b4a851d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:29.942642 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-978e5dca-4fcb-4b25-b7d8-1a2e3b4a851d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:29.944084 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-978e5dca-4fcb-4b25-b7d8-1a2e3b4a851d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.330044 May 25 07:39:29.944722 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 177/371] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:29 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:30.974592 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-d406439e-23bc-4acf-859b-4efabae44c9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:30.975972 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-d406439e-23bc-4acf-859b-4efabae44c9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:30.984218 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d406439e-23bc-4acf-859b-4efabae44c9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:30.990232 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d406439e-23bc-4acf-859b-4efabae44c9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:30.991071 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d406439e-23bc-4acf-859b-4efabae44c9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:31.000456 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d406439e-23bc-4acf-859b-4efabae44c9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:31.192349 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d406439e-23bc-4acf-859b-4efabae44c9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:31.206059 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d406439e-23bc-4acf-859b-4efabae44c9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:31.206059 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d406439e-23bc-4acf-859b-4efabae44c9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:31.206059 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-d406439e-23bc-4acf-859b-4efabae44c9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.235571 May 25 07:39:31.207386 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 195/372] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:30 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:32.229881 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-68bf036b-69c6-4a56-a98c-479c65f7b3e0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:32.231404 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-68bf036b-69c6-4a56-a98c-479c65f7b3e0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:32.243340 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-68bf036b-69c6-4a56-a98c-479c65f7b3e0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:32.248153 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-68bf036b-69c6-4a56-a98c-479c65f7b3e0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:32.249378 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-68bf036b-69c6-4a56-a98c-479c65f7b3e0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:32.251865 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-68bf036b-69c6-4a56-a98c-479c65f7b3e0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:32.573272 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-68bf036b-69c6-4a56-a98c-479c65f7b3e0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:32.604852 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-68bf036b-69c6-4a56-a98c-479c65f7b3e0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:32.607981 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-68bf036b-69c6-4a56-a98c-479c65f7b3e0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:32.614136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-68bf036b-69c6-4a56-a98c-479c65f7b3e0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.390594 May 25 07:39:32.627856 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 178/373] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:32 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 405 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:33.635466 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4cf86380-eb6b-480a-b1ed-64663a626b98 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:33.637173 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4cf86380-eb6b-480a-b1ed-64663a626b98 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:33.648214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4cf86380-eb6b-480a-b1ed-64663a626b98 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:33.651250 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4cf86380-eb6b-480a-b1ed-64663a626b98 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:33.655162 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4cf86380-eb6b-480a-b1ed-64663a626b98 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:33.655162 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4cf86380-eb6b-480a-b1ed-64663a626b98 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:34.001228 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4cf86380-eb6b-480a-b1ed-64663a626b98 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:34.011178 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4cf86380-eb6b-480a-b1ed-64663a626b98 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:34.013059 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4cf86380-eb6b-480a-b1ed-64663a626b98 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:34.014456 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4cf86380-eb6b-480a-b1ed-64663a626b98 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.384727 May 25 07:39:34.026851 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 196/374] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:33 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 397 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:35.038184 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c9539127-9e6f-46d2-a3a3-856fb8692bf6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:35.040680 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c9539127-9e6f-46d2-a3a3-856fb8692bf6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:35.059278 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c9539127-9e6f-46d2-a3a3-856fb8692bf6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:35.059656 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c9539127-9e6f-46d2-a3a3-856fb8692bf6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:35.064709 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c9539127-9e6f-46d2-a3a3-856fb8692bf6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:35.069162 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c9539127-9e6f-46d2-a3a3-856fb8692bf6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:35.330287 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c9539127-9e6f-46d2-a3a3-856fb8692bf6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:35.341595 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c9539127-9e6f-46d2-a3a3-856fb8692bf6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:35.343344 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c9539127-9e6f-46d2-a3a3-856fb8692bf6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:35.344843 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c9539127-9e6f-46d2-a3a3-856fb8692bf6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.314550 May 25 07:39:35.346385 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 179/375] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:35 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:36.365958 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-79e804bb-718b-4735-abba-b55324234926 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:36.367236 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-79e804bb-718b-4735-abba-b55324234926 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:36.394130 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-79e804bb-718b-4735-abba-b55324234926 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:36.395634 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-79e804bb-718b-4735-abba-b55324234926 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:36.396804 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-79e804bb-718b-4735-abba-b55324234926 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:36.397532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-79e804bb-718b-4735-abba-b55324234926 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:36.501426 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-9fbdeee2-7aa4-442d-bf99-c979a1f38a57 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fc32bf61-1ed8-421a-8a0d-533a1c6a23d5"}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:39:36.502729 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-9fbdeee2-7aa4-442d-bf99-c979a1f38a57 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:36.523674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9fbdeee2-7aa4-442d-bf99-c979a1f38a57 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:36.524745 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9fbdeee2-7aa4-442d-bf99-c979a1f38a57 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:36.525977 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9fbdeee2-7aa4-442d-bf99-c979a1f38a57 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:36.526772 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9fbdeee2-7aa4-442d-bf99-c979a1f38a57 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:37.048110 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-79e804bb-718b-4735-abba-b55324234926 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:37.062936 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-79e804bb-718b-4735-abba-b55324234926 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:37.064262 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-79e804bb-718b-4735-abba-b55324234926 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:37.065512 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-79e804bb-718b-4735-abba-b55324234926 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.705814 May 25 07:39:37.066061 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 197/376] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:36 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 707 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:39:37.325096 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-3502cc0b-194e-43cf-97b9-63b5ba4a55b7 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Action: 'create', calling method: .version_select at 0x7fc8643a4280>, body: {"keypair": {"name": "tempest-TestShelveInstance-2078716448", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPp5eCmS0YHXle/3GCPKuMyLz6iJSJW872cpgz3FTuyRmJL/MJiuk6frET6OuscZSQNwhZRBpaWvro1By9dXqXzfBPwPaJXL1WET4Gm4txIRZlNdKc8Nj4NK1KU2mJuvtw=="}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:39:37.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-3502cc0b-194e-43cf-97b9-63b5ba4a55b7 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Getting quotas for project f13c4f9ee9c444d9b9a0d2c2e3ec9142. Resources: {'key_pairs'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:39:37.343404 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-3502cc0b-194e-43cf-97b9-63b5ba4a55b7 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Getting quotas for user f3cd1d48ead14854a5f9f532efcc1e62 and project f13c4f9ee9c444d9b9a0d2c2e3ec9142. Resources: {'key_pairs'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:39:37.408104 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-3502cc0b-194e-43cf-97b9-63b5ba4a55b7 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.251132 May 25 07:39:37.409067 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 198/377] 10.222.0.24 () {60 vars in 1158 bytes} [Wed May 25 07:39:37 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:39:37.942269 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-9fbdeee2-7aa4-442d-bf99-c979a1f38a57 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "POST /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.445535 May 25 07:39:37.943397 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 180/378] 10.222.0.24 () {60 vars in 1322 bytes} [Wed May 25 07:39:36 2022] POST /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196/os-volume_attachments => generated 194 bytes in 1447 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:39:38.085694 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-9ad3f2a3-9ff6-472a-bca5-58b6a86c5608 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:38.086547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-9ad3f2a3-9ff6-472a-bca5-58b6a86c5608 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:38.106389 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9ad3f2a3-9ff6-472a-bca5-58b6a86c5608 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:38.106875 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9ad3f2a3-9ff6-472a-bca5-58b6a86c5608 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:38.107759 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9ad3f2a3-9ff6-472a-bca5-58b6a86c5608 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:38.108148 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9ad3f2a3-9ff6-472a-bca5-58b6a86c5608 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:38.261590 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-9ad3f2a3-9ff6-472a-bca5-58b6a86c5608 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:38.271265 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-9ad3f2a3-9ff6-472a-bca5-58b6a86c5608 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:38.273007 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-9ad3f2a3-9ff6-472a-bca5-58b6a86c5608 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:38.274204 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-9ad3f2a3-9ff6-472a-bca5-58b6a86c5608 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.194000 May 25 07:39:38.274772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 199/379] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:38 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:39.294101 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c83f5194-b452-4ba3-846c-75a2947bcb6c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:39.295617 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c83f5194-b452-4ba3-846c-75a2947bcb6c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:39.303003 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c83f5194-b452-4ba3-846c-75a2947bcb6c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:39.303464 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c83f5194-b452-4ba3-846c-75a2947bcb6c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:39.304230 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c83f5194-b452-4ba3-846c-75a2947bcb6c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:39.304726 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c83f5194-b452-4ba3-846c-75a2947bcb6c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:39.478031 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c83f5194-b452-4ba3-846c-75a2947bcb6c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:39.488128 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c83f5194-b452-4ba3-846c-75a2947bcb6c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:39.490399 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c83f5194-b452-4ba3-846c-75a2947bcb6c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:39.491575 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c83f5194-b452-4ba3-846c-75a2947bcb6c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.202916 May 25 07:39:39.498852 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 181/380] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:39 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:39:40.511576 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-38aea72f-1909-4b52-aaf0-96f2153afdf7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:40.513517 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-38aea72f-1909-4b52-aaf0-96f2153afdf7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:40.521378 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-38aea72f-1909-4b52-aaf0-96f2153afdf7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:40.522171 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-38aea72f-1909-4b52-aaf0-96f2153afdf7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:40.524285 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-38aea72f-1909-4b52-aaf0-96f2153afdf7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:40.524766 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-38aea72f-1909-4b52-aaf0-96f2153afdf7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:40.676700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-38aea72f-1909-4b52-aaf0-96f2153afdf7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:40.679291 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=3,nova_cell1:UPDATE=4 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:39:40.686644 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-38aea72f-1909-4b52-aaf0-96f2153afdf7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:40.688363 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-38aea72f-1909-4b52-aaf0-96f2153afdf7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:40.689573 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-38aea72f-1909-4b52-aaf0-96f2153afdf7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.182657 May 25 07:39:40.690133 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 200/381] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:40 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:41.709680 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-dbcbcd10-f51a-4fec-8208-44c523feb442 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:41.710276 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-dbcbcd10-f51a-4fec-8208-44c523feb442 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:41.716961 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-dbcbcd10-f51a-4fec-8208-44c523feb442 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:41.717508 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-dbcbcd10-f51a-4fec-8208-44c523feb442 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:41.718304 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-dbcbcd10-f51a-4fec-8208-44c523feb442 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:41.718768 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-dbcbcd10-f51a-4fec-8208-44c523feb442 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:41.871459 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-dbcbcd10-f51a-4fec-8208-44c523feb442 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:41.880776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-dbcbcd10-f51a-4fec-8208-44c523feb442 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:41.882449 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-dbcbcd10-f51a-4fec-8208-44c523feb442 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:41.883729 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-dbcbcd10-f51a-4fec-8208-44c523feb442 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.178506 May 25 07:39:41.884343 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 182/382] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:41 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:42.907356 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4d27b464-2433-4b81-ba46-6bab68a41560 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:42.907906 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4d27b464-2433-4b81-ba46-6bab68a41560 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:42.915603 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4d27b464-2433-4b81-ba46-6bab68a41560 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:42.916057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4d27b464-2433-4b81-ba46-6bab68a41560 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:42.916865 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4d27b464-2433-4b81-ba46-6bab68a41560 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:42.917303 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4d27b464-2433-4b81-ba46-6bab68a41560 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:43.049692 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4d27b464-2433-4b81-ba46-6bab68a41560 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:43.058577 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4d27b464-2433-4b81-ba46-6bab68a41560 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:43.060100 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4d27b464-2433-4b81-ba46-6bab68a41560 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:43.061332 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4d27b464-2433-4b81-ba46-6bab68a41560 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.157970 May 25 07:39:43.061885 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 201/383] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:42 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:44.080251 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-3410ec5f-b19e-489e-9626-3904ba3a1421 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:44.080905 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-3410ec5f-b19e-489e-9626-3904ba3a1421 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:44.087779 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3410ec5f-b19e-489e-9626-3904ba3a1421 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:44.088285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3410ec5f-b19e-489e-9626-3904ba3a1421 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:44.089058 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3410ec5f-b19e-489e-9626-3904ba3a1421 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:44.089497 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3410ec5f-b19e-489e-9626-3904ba3a1421 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:44.269250 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-3410ec5f-b19e-489e-9626-3904ba3a1421 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:44.277909 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-3410ec5f-b19e-489e-9626-3904ba3a1421 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:44.279343 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-3410ec5f-b19e-489e-9626-3904ba3a1421 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:44.280507 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-3410ec5f-b19e-489e-9626-3904ba3a1421 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.204452 May 25 07:39:44.286378 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 183/384] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:44 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:39:45.303427 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b8c1de1d-bd99-419f-9dcf-5117e2a3cb25 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:45.304174 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b8c1de1d-bd99-419f-9dcf-5117e2a3cb25 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:45.310870 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b8c1de1d-bd99-419f-9dcf-5117e2a3cb25 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:45.311324 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b8c1de1d-bd99-419f-9dcf-5117e2a3cb25 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:45.312095 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b8c1de1d-bd99-419f-9dcf-5117e2a3cb25 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:45.312562 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b8c1de1d-bd99-419f-9dcf-5117e2a3cb25 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:45.455819 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b8c1de1d-bd99-419f-9dcf-5117e2a3cb25 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:45.465371 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b8c1de1d-bd99-419f-9dcf-5117e2a3cb25 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:45.466880 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b8c1de1d-bd99-419f-9dcf-5117e2a3cb25 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:45.468036 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b8c1de1d-bd99-419f-9dcf-5117e2a3cb25 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.169274 May 25 07:39:45.468628 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 202/385] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:45 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:46.488642 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7a06f86b-4de6-4e36-ae79-5191bb2c07e3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:46.490291 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-7a06f86b-4de6-4e36-ae79-5191bb2c07e3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:46.497645 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7a06f86b-4de6-4e36-ae79-5191bb2c07e3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:46.498128 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7a06f86b-4de6-4e36-ae79-5191bb2c07e3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:46.498973 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7a06f86b-4de6-4e36-ae79-5191bb2c07e3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:46.499325 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7a06f86b-4de6-4e36-ae79-5191bb2c07e3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:46.565139 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-be7e67d2-0ebe-401f-86a1-cdb2ab083d60 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:39:46.566168 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-be7e67d2-0ebe-401f-86a1-cdb2ab083d60 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:46.573178 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-be7e67d2-0ebe-401f-86a1-cdb2ab083d60 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:46.573638 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-be7e67d2-0ebe-401f-86a1-cdb2ab083d60 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:46.574424 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-be7e67d2-0ebe-401f-86a1-cdb2ab083d60 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:46.574868 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-be7e67d2-0ebe-401f-86a1-cdb2ab083d60 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:46.604234 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.objects.instance [None req-be7e67d2-0ebe-401f-86a1-cdb2ab083d60 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lazy-loading 'flavor' on Instance uuid a5ef563c-52c0-40b3-bdf3-dc51e5422196 {{(pid=124675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:39:46.640370 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7a06f86b-4de6-4e36-ae79-5191bb2c07e3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:46.649754 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7a06f86b-4de6-4e36-ae79-5191bb2c07e3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:46.651286 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7a06f86b-4de6-4e36-ae79-5191bb2c07e3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:46.652617 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-7a06f86b-4de6-4e36-ae79-5191bb2c07e3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.169696 May 25 07:39:46.653522 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 184/386] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:46 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:47.022489 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-be7e67d2-0ebe-401f-86a1-cdb2ab083d60 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "POST /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196/action" status: 200 len: 32 microversion: 2.1 time: 0.461504 May 25 07:39:47.023106 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 203/387] 10.222.0.24 () {60 vars in 1277 bytes} [Wed May 25 07:39:46 2022] POST /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196/action => generated 32 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 25 07:39:47.032221 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d68371a4-db4b-448b-9367-1f38dedb3cb7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:47.032999 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d68371a4-db4b-448b-9367-1f38dedb3cb7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:47.039223 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d68371a4-db4b-448b-9367-1f38dedb3cb7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:47.039684 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d68371a4-db4b-448b-9367-1f38dedb3cb7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:47.040444 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d68371a4-db4b-448b-9367-1f38dedb3cb7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:47.040913 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d68371a4-db4b-448b-9367-1f38dedb3cb7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:47.174361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d68371a4-db4b-448b-9367-1f38dedb3cb7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:47.183789 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d68371a4-db4b-448b-9367-1f38dedb3cb7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1733 microversion: 2.1 time: 0.155296 May 25 07:39:47.184358 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 185/388] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:47 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1733 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:47.668879 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=4 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:39:47.673542 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-c373fa16-4d98-4e5e-a24c-4d3ba012e183 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:47.675398 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-c373fa16-4d98-4e5e-a24c-4d3ba012e183 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:47.681878 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c373fa16-4d98-4e5e-a24c-4d3ba012e183 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:47.682332 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c373fa16-4d98-4e5e-a24c-4d3ba012e183 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:47.683100 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c373fa16-4d98-4e5e-a24c-4d3ba012e183 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:47.683583 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c373fa16-4d98-4e5e-a24c-4d3ba012e183 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:47.816093 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-c373fa16-4d98-4e5e-a24c-4d3ba012e183 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:47.824878 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-c373fa16-4d98-4e5e-a24c-4d3ba012e183 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:47.830127 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-c373fa16-4d98-4e5e-a24c-4d3ba012e183 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:47.830127 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-c373fa16-4d98-4e5e-a24c-4d3ba012e183 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.159823 May 25 07:39:47.830127 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 204/389] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:47 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:48.203063 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-630c0930-b362-4367-911c-98c45b53b590 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:48.203807 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-630c0930-b362-4367-911c-98c45b53b590 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:48.212765 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-630c0930-b362-4367-911c-98c45b53b590 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:48.213212 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-630c0930-b362-4367-911c-98c45b53b590 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:48.213990 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-630c0930-b362-4367-911c-98c45b53b590 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:48.214427 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-630c0930-b362-4367-911c-98c45b53b590 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:48.349747 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-876d642d-d3ca-4116-99a5-2353339ff79a req-731c7383-7b0a-4478-ac11-412017faf242 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d360341-449d-4b49-8b66-a02a969171fd", "name": "network-vif-plugged", "status": "completed", "tag": "5b9220dd-eeaa-4ea1-a0cd-e54c1dbfe455"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:39:48.357553 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-630c0930-b362-4367-911c-98c45b53b590 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:48.361881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-876d642d-d3ca-4116-99a5-2353339ff79a req-731c7383-7b0a-4478-ac11-412017faf242 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:48.362334 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-876d642d-d3ca-4116-99a5-2353339ff79a req-731c7383-7b0a-4478-ac11-412017faf242 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:48.365750 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-630c0930-b362-4367-911c-98c45b53b590 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1733 microversion: 2.1 time: 0.166858 May 25 07:39:48.366314 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 186/390] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:48 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1733 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:48.373823 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-876d642d-d3ca-4116-99a5-2353339ff79a req-731c7383-7b0a-4478-ac11-412017faf242 service nova] Creating event network-vif-plugged:5b9220dd-eeaa-4ea1-a0cd-e54c1dbfe455 for instance 6d360341-449d-4b49-8b66-a02a969171fd on hv-cinder-82549 May 25 07:39:48.378632 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-876d642d-d3ca-4116-99a5-2353339ff79a req-731c7383-7b0a-4478-ac11-412017faf242 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032532 May 25 07:39:48.379209 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 205/391] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:39:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:39:48.845736 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-343afb97-18f8-49f6-9a94-bb7d8f37f6de tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:48.846342 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-343afb97-18f8-49f6-9a94-bb7d8f37f6de tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:48.852657 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-343afb97-18f8-49f6-9a94-bb7d8f37f6de tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:48.853109 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-343afb97-18f8-49f6-9a94-bb7d8f37f6de tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:48.853874 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-343afb97-18f8-49f6-9a94-bb7d8f37f6de tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:48.854324 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-343afb97-18f8-49f6-9a94-bb7d8f37f6de tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:48.991549 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-343afb97-18f8-49f6-9a94-bb7d8f37f6de tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:49.000285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-343afb97-18f8-49f6-9a94-bb7d8f37f6de tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:49.001826 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-343afb97-18f8-49f6-9a94-bb7d8f37f6de tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:49.003048 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-343afb97-18f8-49f6-9a94-bb7d8f37f6de tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.161197 May 25 07:39:49.003515 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 187/392] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:48 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:49.384216 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-1017c5f2-c3ea-4ecd-acca-9a1739f607be tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:49.384978 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-1017c5f2-c3ea-4ecd-acca-9a1739f607be tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:49.391212 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1017c5f2-c3ea-4ecd-acca-9a1739f607be tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:49.391670 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1017c5f2-c3ea-4ecd-acca-9a1739f607be tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:49.392441 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1017c5f2-c3ea-4ecd-acca-9a1739f607be tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:49.392933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1017c5f2-c3ea-4ecd-acca-9a1739f607be tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:49.529652 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-1017c5f2-c3ea-4ecd-acca-9a1739f607be tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:49.537608 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-1017c5f2-c3ea-4ecd-acca-9a1739f607be tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1733 microversion: 2.1 time: 0.158100 May 25 07:39:49.538924 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 206/393] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:49 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1733 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:50.021357 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-f8ccae90-781f-4c84-8b59-618d9913f26c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:50.021940 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-f8ccae90-781f-4c84-8b59-618d9913f26c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:50.029394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f8ccae90-781f-4c84-8b59-618d9913f26c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:50.029910 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f8ccae90-781f-4c84-8b59-618d9913f26c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:50.030678 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f8ccae90-781f-4c84-8b59-618d9913f26c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:50.031175 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f8ccae90-781f-4c84-8b59-618d9913f26c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:50.169228 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-f8ccae90-781f-4c84-8b59-618d9913f26c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:50.177795 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-f8ccae90-781f-4c84-8b59-618d9913f26c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:50.179787 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-f8ccae90-781f-4c84-8b59-618d9913f26c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:50.180988 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-f8ccae90-781f-4c84-8b59-618d9913f26c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.163615 May 25 07:39:50.181542 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 188/394] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:50 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:50.422906 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-fc9da646-32f1-44f9-891f-06d22016c633 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:50.423460 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-fc9da646-32f1-44f9-891f-06d22016c633 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:50.430688 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fc9da646-32f1-44f9-891f-06d22016c633 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:50.431147 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fc9da646-32f1-44f9-891f-06d22016c633 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:50.431921 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fc9da646-32f1-44f9-891f-06d22016c633 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:50.432365 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fc9da646-32f1-44f9-891f-06d22016c633 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:50.455263 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-fc9da646-32f1-44f9-891f-06d22016c633 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194/ips" status: 200 len: 150 microversion: 2.1 time: 0.036255 May 25 07:39:50.455834 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 207/395] 10.222.0.24 () {58 vars in 1247 bytes} [Wed May 25 07:39:50 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194/ips => generated 150 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:39:50.466206 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-01fbd8e2-cad6-4663-accf-74b90c258587 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "2f9207fa-dc4c-455f-90c5-23e6a708ee5a"}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:39:50.467555 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-01fbd8e2-cad6-4663-accf-74b90c258587 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:50.473472 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-01fbd8e2-cad6-4663-accf-74b90c258587 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:50.473921 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-01fbd8e2-cad6-4663-accf-74b90c258587 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:50.474693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-01fbd8e2-cad6-4663-accf-74b90c258587 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:50.475626 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-01fbd8e2-cad6-4663-accf-74b90c258587 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:50.555672 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-54707abe-c2ef-4ae6-9f55-1a6b91b30970 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:50.556323 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-54707abe-c2ef-4ae6-9f55-1a6b91b30970 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:50.556893 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-01fbd8e2-cad6-4663-accf-74b90c258587 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] HTTP exception thrown: Invalid volume: volume 2f9207fa-dc4c-455f-90c5-23e6a708ee5a is already attached to instances: f7f15090-8fe0-4ebd-b4e6-2aad101f417b May 25 07:39:50.558649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-01fbd8e2-cad6-4663-accf-74b90c258587 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Request method failure captured: May 25 07:39:50.558649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: POST /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194/os-volume_attachments HTTP/1.1 May 25 07:39:50.558649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:39:50.558649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:39:50.558649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:39:50.558649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 74 May 25 07:39:50.558649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:39:50.558649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:39:50.558649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:39:50.558649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:39:50.558649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdyI17YkjQqKsTicl5BdlTZvAyQ_GMXlLJBh83Og-ZMS2KVi2Us0aJRqbM6uLQgUDMPeORhcs3ta8E3UdJWMvBXVjTqxdi2zYK0EmeD76I0JveUsx0Rz9WMLKSIeeZZQrA5vc_1CQNMm1pSzCady0n-o4b9yXkMaGi83bIjdMzlEcds May 25 07:39:50.558649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:39:50.558649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:39:50.558649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:39:50.558649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:39:50.558649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:39:50.558649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:39:50.558649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:39:50.558649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:39:50.558649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:39:50.558649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:39:50.559948 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2d8e35800ce043acbcb027ce406ed2e7", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:39:50.559948 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:39:50.559948 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:39:50.559948 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:39:50.559948 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:39:50.559948 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:39:50.559948 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:39:50.559948 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: 0487ea9076ee4baf8138fdc25ce02522 May 25 07:39:50.559948 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:39:50.559948 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: May 25 07:39:50.559948 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {"volumeAttachment": {"volumeId": "2f9207fa-dc4c-455f-90c5-23e6a708ee5a"}} May 25 07:39:50.559948 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:39:50.560748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Invalid volume: volume 2f9207fa-dc4c-455f-90c5-23e6a708ee5a is already attached to instances: f7f15090-8fe0-4ebd-b4e6-2aad101f417b May 25 07:39:50.560748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'server_id': '93f35115-ef0f-4ed9-b573-04bd28bed194', 'body': {'volumeAttachment': {'volumeId': '2f9207fa-dc4c-455f-90c5-23e6a708ee5a'}}} May 25 07:39:50.560748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:39:50.560748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:39:50.560748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 25 07:39:50.560748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 25 07:39:50.560748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 07:39:50.560748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 07:39:50.560748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 25 07:39:50.560748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 25 07:39:50.560748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 25 07:39:50.560748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 25 07:39:50.560748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 25 07:39:50.560748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 25 07:39:50.560748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 2f9207fa-dc4c-455f-90c5-23e6a708ee5a is already attached to instances: f7f15090-8fe0-4ebd-b4e6-2aad101f417b May 25 07:39:50.560748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:39:50.560748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:39:50.560748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:39:50.560748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:39:50.561915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:39:50.561915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:39:50.561915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:39:50.561915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:39:50.561915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:39:50.561915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:39:50.561915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 07:39:50.561915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 07:39:50.561915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 07:39:50.561915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 07:39:50.561915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 07:39:50.561915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 07:39:50.561915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 25 07:39:50.561915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 25 07:39:50.561915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 2f9207fa-dc4c-455f-90c5-23e6a708ee5a is already attached to instances: f7f15090-8fe0-4ebd-b4e6-2aad101f417b May 25 07:39:50.561915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:39:50.561915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:39:50.561915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:39:50.561915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:39:50.561915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:39:50.563054 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:39:50.563054 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:39:50.563054 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:39:50.563054 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 2f9207fa-dc4c-455f-90c5-23e6a708ee5a is already attached to instances: f7f15090-8fe0-4ebd-b4e6-2aad101f417b May 25 07:39:50.563054 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:39:50.563054 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-01fbd8e2-cad6-4663-accf-74b90c258587 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Returning 400 to user: Invalid volume: volume 2f9207fa-dc4c-455f-90c5-23e6a708ee5a is already attached to instances: f7f15090-8fe0-4ebd-b4e6-2aad101f417b {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:39:50.563054 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-01fbd8e2-cad6-4663-accf-74b90c258587 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "POST /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.097820 May 25 07:39:50.563054 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 189/396] 10.222.0.24 () {60 vars in 1322 bytes} [Wed May 25 07:39:50 2022] POST /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194/os-volume_attachments => generated 174 bytes in 99 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 07:39:50.563580 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-54707abe-c2ef-4ae6-9f55-1a6b91b30970 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:50.563580 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-54707abe-c2ef-4ae6-9f55-1a6b91b30970 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:50.564138 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-54707abe-c2ef-4ae6-9f55-1a6b91b30970 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:50.564667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-54707abe-c2ef-4ae6-9f55-1a6b91b30970 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:50.569411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-65e51486-1e22-4afd-b409-723ab86ceda5 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:50.569926 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-65e51486-1e22-4afd-b409-723ab86ceda5 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:50.576048 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-65e51486-1e22-4afd-b409-723ab86ceda5 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:50.576680 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-65e51486-1e22-4afd-b409-723ab86ceda5 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:50.577476 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-65e51486-1e22-4afd-b409-723ab86ceda5 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:50.577919 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-65e51486-1e22-4afd-b409-723ab86ceda5 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:50.611081 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-65e51486-1e22-4afd-b409-723ab86ceda5 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Going to try to terminate instance {{(pid=124674) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:39:50.697773 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-54707abe-c2ef-4ae6-9f55-1a6b91b30970 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:50.705069 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-54707abe-c2ef-4ae6-9f55-1a6b91b30970 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1733 microversion: 2.1 time: 0.153887 May 25 07:39:50.705641 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 208/397] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:50 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:39:50.879290 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-65e51486-1e22-4afd-b409-723ab86ceda5 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "DELETE /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 204 len: 0 microversion: 2.1 time: 0.313675 May 25 07:39:50.879921 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 190/398] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:39:50 2022] DELETE /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 0 bytes in 315 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 07:39:50.889245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-9b271e57-eb1f-4f30-9ef9-164bd9e636ff tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:50.889764 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-9b271e57-eb1f-4f30-9ef9-164bd9e636ff tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:50.895822 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9b271e57-eb1f-4f30-9ef9-164bd9e636ff tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:50.896278 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9b271e57-eb1f-4f30-9ef9-164bd9e636ff tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:50.897252 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9b271e57-eb1f-4f30-9ef9-164bd9e636ff tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:50.897970 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9b271e57-eb1f-4f30-9ef9-164bd9e636ff tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:51.031671 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-9b271e57-eb1f-4f30-9ef9-164bd9e636ff tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:51.040163 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-9b271e57-eb1f-4f30-9ef9-164bd9e636ff tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 200 len: 1679 microversion: 2.1 time: 0.154990 May 25 07:39:51.040774 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 209/399] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:50 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:51.200722 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d3333a73-7c9a-42ea-a723-6475ab00bcd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:51.201422 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d3333a73-7c9a-42ea-a723-6475ab00bcd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:51.207965 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d3333a73-7c9a-42ea-a723-6475ab00bcd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:51.208414 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d3333a73-7c9a-42ea-a723-6475ab00bcd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:51.209210 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d3333a73-7c9a-42ea-a723-6475ab00bcd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:51.209776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d3333a73-7c9a-42ea-a723-6475ab00bcd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:51.224236 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:39:51.349202 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d3333a73-7c9a-42ea-a723-6475ab00bcd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:51.357756 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d3333a73-7c9a-42ea-a723-6475ab00bcd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:51.364239 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d3333a73-7c9a-42ea-a723-6475ab00bcd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:51.364239 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d3333a73-7c9a-42ea-a723-6475ab00bcd8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.164531 May 25 07:39:51.364239 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 191/400] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:51 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:51.723898 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ba8f9b4c-dca7-4e7f-9ebe-125742f738fa tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:51.724589 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ba8f9b4c-dca7-4e7f-9ebe-125742f738fa tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:51.727111 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=1 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:39:51.731920 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ba8f9b4c-dca7-4e7f-9ebe-125742f738fa tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:51.732368 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ba8f9b4c-dca7-4e7f-9ebe-125742f738fa tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:51.738303 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ba8f9b4c-dca7-4e7f-9ebe-125742f738fa tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:51.738303 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ba8f9b4c-dca7-4e7f-9ebe-125742f738fa tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:51.869405 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ba8f9b4c-dca7-4e7f-9ebe-125742f738fa tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:51.877866 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ba8f9b4c-dca7-4e7f-9ebe-125742f738fa tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1733 microversion: 2.1 time: 0.157884 May 25 07:39:51.878432 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 210/401] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:51 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1733 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:52.058456 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-3d65e2af-9c68-44bd-bfa0-639429506027 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:52.059071 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-3d65e2af-9c68-44bd-bfa0-639429506027 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:52.065303 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3d65e2af-9c68-44bd-bfa0-639429506027 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:52.065750 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3d65e2af-9c68-44bd-bfa0-639429506027 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:52.066517 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3d65e2af-9c68-44bd-bfa0-639429506027 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:52.066983 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3d65e2af-9c68-44bd-bfa0-639429506027 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:52.197016 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-3d65e2af-9c68-44bd-bfa0-639429506027 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:52.204433 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-3d65e2af-9c68-44bd-bfa0-639429506027 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 200 len: 1679 microversion: 2.1 time: 0.150639 May 25 07:39:52.205065 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 192/402] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:52 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:52.379500 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a4e01356-ec12-436d-9812-08d9c654464b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:52.380033 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a4e01356-ec12-436d-9812-08d9c654464b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:52.387041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a4e01356-ec12-436d-9812-08d9c654464b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:52.387496 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a4e01356-ec12-436d-9812-08d9c654464b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:52.388257 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a4e01356-ec12-436d-9812-08d9c654464b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:52.388725 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a4e01356-ec12-436d-9812-08d9c654464b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:52.517855 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a4e01356-ec12-436d-9812-08d9c654464b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:52.526268 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a4e01356-ec12-436d-9812-08d9c654464b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:52.527770 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a4e01356-ec12-436d-9812-08d9c654464b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:52.529182 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a4e01356-ec12-436d-9812-08d9c654464b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1807 microversion: 2.20 time: 0.153876 May 25 07:39:52.529737 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 211/403] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:52 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1807 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:52.895060 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-4d1bdee4-b5ba-4bf2-ae40-efbc66a55093 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:52.895620 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-4d1bdee4-b5ba-4bf2-ae40-efbc66a55093 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:52.902279 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4d1bdee4-b5ba-4bf2-ae40-efbc66a55093 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:52.902757 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4d1bdee4-b5ba-4bf2-ae40-efbc66a55093 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:52.903521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4d1bdee4-b5ba-4bf2-ae40-efbc66a55093 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:52.903956 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4d1bdee4-b5ba-4bf2-ae40-efbc66a55093 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:53.035719 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-4d1bdee4-b5ba-4bf2-ae40-efbc66a55093 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:53.044492 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-4d1bdee4-b5ba-4bf2-ae40-efbc66a55093 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1733 microversion: 2.1 time: 0.153369 May 25 07:39:53.045069 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 193/404] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:52 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1733 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:53.222703 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-2f51ba1e-72f7-4d0a-8503-b2efbdccbf94 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:53.223333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-2f51ba1e-72f7-4d0a-8503-b2efbdccbf94 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:53.230662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2f51ba1e-72f7-4d0a-8503-b2efbdccbf94 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:53.235043 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2f51ba1e-72f7-4d0a-8503-b2efbdccbf94 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:53.235043 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2f51ba1e-72f7-4d0a-8503-b2efbdccbf94 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:53.235043 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2f51ba1e-72f7-4d0a-8503-b2efbdccbf94 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:53.362458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-2f51ba1e-72f7-4d0a-8503-b2efbdccbf94 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:53.370415 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-2f51ba1e-72f7-4d0a-8503-b2efbdccbf94 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 200 len: 1679 microversion: 2.1 time: 0.151581 May 25 07:39:53.370985 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 212/405] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:53 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 1679 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:53.547213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-6b53370d-0fe0-4664-a36a-01ac8810fa9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:53.547726 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-6b53370d-0fe0-4664-a36a-01ac8810fa9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:53.554745 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6b53370d-0fe0-4664-a36a-01ac8810fa9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:53.557141 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6b53370d-0fe0-4664-a36a-01ac8810fa9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:53.557141 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6b53370d-0fe0-4664-a36a-01ac8810fa9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:53.557141 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6b53370d-0fe0-4664-a36a-01ac8810fa9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:53.688734 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-6b53370d-0fe0-4664-a36a-01ac8810fa9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:53.698972 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-6b53370d-0fe0-4664-a36a-01ac8810fa9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:53.700515 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-6b53370d-0fe0-4664-a36a-01ac8810fa9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:53.702785 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-6b53370d-0fe0-4664-a36a-01ac8810fa9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1794 microversion: 2.20 time: 0.158712 May 25 07:39:53.702785 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 194/406] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:39:53 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1794 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:39:54.062166 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b5216dab-6220-4806-9395-50f50179ecaf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:54.062872 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b5216dab-6220-4806-9395-50f50179ecaf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:54.069072 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b5216dab-6220-4806-9395-50f50179ecaf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:54.070035 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b5216dab-6220-4806-9395-50f50179ecaf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:54.070914 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b5216dab-6220-4806-9395-50f50179ecaf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:54.071366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b5216dab-6220-4806-9395-50f50179ecaf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:54.263135 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b5216dab-6220-4806-9395-50f50179ecaf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:54.271165 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b5216dab-6220-4806-9395-50f50179ecaf tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1733 microversion: 2.1 time: 0.213048 May 25 07:39:54.271726 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 213/407] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:54 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1733 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:54.389086 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-0311940d-6c03-4f21-9461-ab42f0e23268 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:54.389086 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-0311940d-6c03-4f21-9461-ab42f0e23268 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:54.396401 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0311940d-6c03-4f21-9461-ab42f0e23268 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:54.397873 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0311940d-6c03-4f21-9461-ab42f0e23268 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:54.398824 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0311940d-6c03-4f21-9461-ab42f0e23268 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:54.399421 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0311940d-6c03-4f21-9461-ab42f0e23268 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:54.468449 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-0311940d-6c03-4f21-9461-ab42f0e23268 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:54.476921 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-0311940d-6c03-4f21-9461-ab42f0e23268 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 200 len: 1611 microversion: 2.1 time: 0.092643 May 25 07:39:54.477680 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 195/408] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:54 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 1611 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:54.654102 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-9ca5dc60-4f33-4977-8718-5cbc9a575be7 req-8e1eed04-1a64-4b81-90a8-06bba7baf5c3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "93f35115-ef0f-4ed9-b573-04bd28bed194", "name": "network-vif-deleted", "tag": "14d0c437-f7e3-486f-860a-7d02ab291df3"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:39:54.662760 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-9ca5dc60-4f33-4977-8718-5cbc9a575be7 req-8e1eed04-1a64-4b81-90a8-06bba7baf5c3 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:54.662927 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-9ca5dc60-4f33-4977-8718-5cbc9a575be7 req-8e1eed04-1a64-4b81-90a8-06bba7baf5c3 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:54.675352 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-9ca5dc60-4f33-4977-8718-5cbc9a575be7 req-8e1eed04-1a64-4b81-90a8-06bba7baf5c3 service nova] Creating event network-vif-deleted:14d0c437-f7e3-486f-860a-7d02ab291df3 for instance 93f35115-ef0f-4ed9-b573-04bd28bed194 on hv-cinder-82549 May 25 07:39:54.681175 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-9ca5dc60-4f33-4977-8718-5cbc9a575be7 req-8e1eed04-1a64-4b81-90a8-06bba7baf5c3 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030757 May 25 07:39:54.681809 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 214/409] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:39:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:39:55.289290 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-62c570e1-0f19-41d5-b043-66d4988f57d5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:55.290474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-62c570e1-0f19-41d5-b043-66d4988f57d5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:55.296745 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-62c570e1-0f19-41d5-b043-66d4988f57d5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:55.297403 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-62c570e1-0f19-41d5-b043-66d4988f57d5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:55.298336 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-62c570e1-0f19-41d5-b043-66d4988f57d5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:55.298931 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-62c570e1-0f19-41d5-b043-66d4988f57d5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:55.437507 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-62c570e1-0f19-41d5-b043-66d4988f57d5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:55.446381 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-62c570e1-0f19-41d5-b043-66d4988f57d5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1733 microversion: 2.1 time: 0.161016 May 25 07:39:55.446973 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 196/410] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:55 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1733 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:55.496021 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4ca16bf7-dfc6-4a34-9a6c-6a3974007c31 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:55.496904 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4ca16bf7-dfc6-4a34-9a6c-6a3974007c31 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:55.503966 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4ca16bf7-dfc6-4a34-9a6c-6a3974007c31 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:55.504650 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4ca16bf7-dfc6-4a34-9a6c-6a3974007c31 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:55.505519 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4ca16bf7-dfc6-4a34-9a6c-6a3974007c31 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:55.506047 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4ca16bf7-dfc6-4a34-9a6c-6a3974007c31 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:55.540322 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4ca16bf7-dfc6-4a34-9a6c-6a3974007c31 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:55.540901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4ca16bf7-dfc6-4a34-9a6c-6a3974007c31 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:55.541455 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.objects.instance [None req-4ca16bf7-dfc6-4a34-9a6c-6a3974007c31 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lazy-loading 'fault' on Instance uuid 93f35115-ef0f-4ed9-b573-04bd28bed194 {{(pid=124675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:39:55.589709 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4ca16bf7-dfc6-4a34-9a6c-6a3974007c31 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:55.601564 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4ca16bf7-dfc6-4a34-9a6c-6a3974007c31 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 200 len: 1328 microversion: 2.1 time: 0.110861 May 25 07:39:55.602151 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 215/411] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:55 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 1328 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:56.463314 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-8eda9d82-3d5c-4733-9cfb-bc6a07b22f95 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:56.463930 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-8eda9d82-3d5c-4733-9cfb-bc6a07b22f95 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:56.470431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8eda9d82-3d5c-4733-9cfb-bc6a07b22f95 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:56.470889 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8eda9d82-3d5c-4733-9cfb-bc6a07b22f95 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:56.471653 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8eda9d82-3d5c-4733-9cfb-bc6a07b22f95 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:56.472087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8eda9d82-3d5c-4733-9cfb-bc6a07b22f95 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:56.599727 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-8eda9d82-3d5c-4733-9cfb-bc6a07b22f95 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:56.608638 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-8eda9d82-3d5c-4733-9cfb-bc6a07b22f95 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1733 microversion: 2.1 time: 0.149299 May 25 07:39:56.609850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 197/412] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:56 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1733 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:39:56.619307 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-17f113b0-1c7c-4920-b29f-63f1c5073eda tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:56.619926 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-17f113b0-1c7c-4920-b29f-63f1c5073eda tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:56.626523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-17f113b0-1c7c-4920-b29f-63f1c5073eda tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:56.626978 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-17f113b0-1c7c-4920-b29f-63f1c5073eda tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:56.627862 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-17f113b0-1c7c-4920-b29f-63f1c5073eda tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:56.628568 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-17f113b0-1c7c-4920-b29f-63f1c5073eda tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:56.642137 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-17f113b0-1c7c-4920-b29f-63f1c5073eda tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] HTTP exception thrown: Instance 93f35115-ef0f-4ed9-b573-04bd28bed194 could not be found. May 25 07:39:56.643772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-17f113b0-1c7c-4920-b29f-63f1c5073eda tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Request method failure captured: May 25 07:39:56.643772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 HTTP/1.1 May 25 07:39:56.643772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:39:56.643772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:39:56.643772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:39:56.643772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:39:56.643772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:39:56.643772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:39:56.643772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:39:56.643772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:39:56.643772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijdyI17YkjQqKsTicl5BdlTZvAyQ_GMXlLJBh83Og-ZMS2KVi2Us0aJRqbM6uLQgUDMPeORhcs3ta8E3UdJWMvBXVjTqxdi2zYK0EmeD76I0JveUsx0Rz9WMLKSIeeZZQrA5vc_1CQNMm1pSzCady0n-o4b9yXkMaGi83bIjdMzlEcds May 25 07:39:56.643772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:39:56.643772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:39:56.643772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:39:56.643772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:39:56.643772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:39:56.643772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:39:56.643772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:39:56.643772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:39:56.643772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:39:56.643772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:39:56.645232 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2d8e35800ce043acbcb027ce406ed2e7", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:39:56.645232 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:39:56.645232 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:39:56.645232 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:39:56.645232 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:39:56.645232 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:39:56.645232 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:39:56.645232 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: 0487ea9076ee4baf8138fdc25ce02522 May 25 07:39:56.645232 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:39:56.645232 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:39:56.645232 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance 93f35115-ef0f-4ed9-b573-04bd28bed194 could not be found. May 25 07:39:56.645232 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': '93f35115-ef0f-4ed9-b573-04bd28bed194'} May 25 07:39:56.646085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:39:56.646085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:39:56.646085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:39:56.646085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:39:56.646085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:39:56.646085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:39:56.646085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:39:56.646085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:39:56.646085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:39:56.646085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:39:56.646085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93f35115-ef0f-4ed9-b573-04bd28bed194 could not be found. May 25 07:39:56.646085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:39:56.646085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:39:56.646085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:39:56.646085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:39:56.646085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:39:56.646085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:39:56.646085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:39:56.646085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:39:56.646085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:39:56.647947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:39:56.647947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:39:56.647947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:39:56.647947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:39:56.647947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:39:56.647947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:39:56.647947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:39:56.647947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93f35115-ef0f-4ed9-b573-04bd28bed194 could not be found. May 25 07:39:56.647947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:39:56.647947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:39:56.647947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:39:56.647947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:39:56.647947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:39:56.647947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:39:56.647947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:39:56.647947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:39:56.647947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93f35115-ef0f-4ed9-b573-04bd28bed194 could not be found. May 25 07:39:56.647947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:39:56.649341 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-17f113b0-1c7c-4920-b29f-63f1c5073eda tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Returning 404 to user: Instance 93f35115-ef0f-4ed9-b573-04bd28bed194 could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:39:56.649341 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-17f113b0-1c7c-4920-b29f-63f1c5073eda tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 404 len: 111 microversion: 2.1 time: 0.030547 May 25 07:39:56.649341 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 216/413] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:56 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:39:56.654115 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-80e26993-a9c4-4c8e-b213-7898698013f3 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '.version_select at 0x7fc86434bee0>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:56.657420 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR oslo.messaging._drivers.impl_rabbit [None req-80e26993-a9c4-4c8e-b213-7898698013f3 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [55b584e2-a895-4d80-9d77-6ea0d53e72eb] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 25 07:39:57.627347 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8d2f9413-8f21-484a-a082-f6e25a1db210 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:57.627969 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-8d2f9413-8f21-484a-a082-f6e25a1db210 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:57.635943 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8d2f9413-8f21-484a-a082-f6e25a1db210 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:57.641656 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8d2f9413-8f21-484a-a082-f6e25a1db210 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:57.641656 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8d2f9413-8f21-484a-a082-f6e25a1db210 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:57.641656 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8d2f9413-8f21-484a-a082-f6e25a1db210 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:57.653729 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:39:57.665415 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO oslo.messaging._drivers.impl_rabbit [None req-80e26993-a9c4-4c8e-b213-7898698013f3 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [55b584e2-a895-4d80-9d77-6ea0d53e72eb] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 48934. May 25 07:39:57.773809 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-80e26993-a9c4-4c8e-b213-7898698013f3 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-796272905" status: 202 len: 0 microversion: 2.1 time: 1.123401 May 25 07:39:57.774054 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-8d2f9413-8f21-484a-a082-f6e25a1db210 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:57.774407 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 198/414] 10.222.0.24 () {58 vars in 1217 bytes} [Wed May 25 07:39:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-796272905 => generated 0 bytes in 1125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 07:39:57.782683 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-8d2f9413-8f21-484a-a082-f6e25a1db210 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1733 microversion: 2.1 time: 0.159348 May 25 07:39:57.784195 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 217/415] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:57 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1733 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:39:57.957821 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-8c78a96d-bebc-4dce-9d32-cf32a8ccccc2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-425357468", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-2078716448", "security_groups": [{"name": "tempest-secgroup-smoke-203561701"}], "networks": [{"uuid": "865acc30-354d-443a-90ac-e550f16275c5"}], "block_device_mapping_v2": [{"uuid": "da57c6b5-42c9-4c38-b99e-3f21cba9553f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:39:58.088464 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.network.neutron [None req-8c78a96d-bebc-4dce-9d32-cf32a8ccccc2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] validate_networks() for [('865acc30-354d-443a-90ac-e550f16275c5', None, None, None, None, None)] {{(pid=124674) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:39:58.460508 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-8c78a96d-bebc-4dce-9d32-cf32a8ccccc2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Flavor limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:39:58.467032 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-8c78a96d-bebc-4dce-9d32-cf32a8ccccc2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Image limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:39:58.467032 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-8c78a96d-bebc-4dce-9d32-cf32a8ccccc2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Flavor pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:39:58.467032 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-8c78a96d-bebc-4dce-9d32-cf32a8ccccc2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Image pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:39:58.467032 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-8c78a96d-bebc-4dce-9d32-cf32a8ccccc2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:39:58.471797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8c78a96d-bebc-4dce-9d32-cf32a8ccccc2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:58.472242 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8c78a96d-bebc-4dce-9d32-cf32a8ccccc2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:58.473099 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8c78a96d-bebc-4dce-9d32-cf32a8ccccc2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:58.473543 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8c78a96d-bebc-4dce-9d32-cf32a8ccccc2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:58.491911 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-8c78a96d-bebc-4dce-9d32-cf32a8ccccc2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Getting quotas for project f13c4f9ee9c444d9b9a0d2c2e3ec9142. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:39:58.496198 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-8c78a96d-bebc-4dce-9d32-cf32a8ccccc2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Getting quotas for user f3cd1d48ead14854a5f9f532efcc1e62 and project f13c4f9ee9c444d9b9a0d2c2e3ec9142. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:39:58.555935 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-8c78a96d-bebc-4dce-9d32-cf32a8ccccc2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Going to run 1 instances... {{(pid=124674) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:39:58.558089 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-8c78a96d-bebc-4dce-9d32-cf32a8ccccc2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='da57c6b5-42c9-4c38-b99e-3f21cba9553f',volume_size=None,volume_type=None)] {{(pid=124674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:39:58.799872 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b4073c83-49f2-4637-9250-0737d31409d6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:58.800571 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b4073c83-49f2-4637-9250-0737d31409d6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:58.808534 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b4073c83-49f2-4637-9250-0737d31409d6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:58.808999 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b4073c83-49f2-4637-9250-0737d31409d6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:58.809784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b4073c83-49f2-4637-9250-0737d31409d6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:58.810227 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b4073c83-49f2-4637-9250-0737d31409d6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:58.944224 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b4073c83-49f2-4637-9250-0737d31409d6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:58.952184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b4073c83-49f2-4637-9250-0737d31409d6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1733 microversion: 2.1 time: 0.156941 May 25 07:39:58.952791 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 218/416] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:58 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1733 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:39:58.957395 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-f195958d-2341-4031-8905-6e7d70252d92 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:58.957877 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-f195958d-2341-4031-8905-6e7d70252d92 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:58.963855 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f195958d-2341-4031-8905-6e7d70252d92 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:58.964313 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f195958d-2341-4031-8905-6e7d70252d92 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:58.965125 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f195958d-2341-4031-8905-6e7d70252d92 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:58.965569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f195958d-2341-4031-8905-6e7d70252d92 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:58.985781 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-8c78a96d-bebc-4dce-9d32-cf32a8ccccc2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.031973 May 25 07:39:58.986825 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 199/417] 10.222.0.24 () {60 vars in 1146 bytes} [Wed May 25 07:39:57 2022] POST /compute/v2.1/servers => generated 405 bytes in 1033 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 07:39:58.997449 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-271f8007-592c-4933-9f7b-95f1f13950ef tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:58.998144 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-271f8007-592c-4933-9f7b-95f1f13950ef tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:59.060538 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-271f8007-592c-4933-9f7b-95f1f13950ef tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:39:59.069468 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-271f8007-592c-4933-9f7b-95f1f13950ef tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1088 microversion: 2.1 time: 0.075590 May 25 07:39:59.070182 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 200/418] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:58 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1088 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:39:59.093847 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.objects.instance [None req-f195958d-2341-4031-8905-6e7d70252d92 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lazy-loading 'services' on Instance uuid f7f15090-8fe0-4ebd-b4e6-2aad101f417b {{(pid=124675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:39:59.337760 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-f195958d-2341-4031-8905-6e7d70252d92 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b/os-volume_attachments/2f9207fa-dc4c-455f-90c5-23e6a708ee5a" status: 202 len: 0 microversion: 2.1 time: 0.383740 May 25 07:39:59.338346 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 219/419] 10.222.0.24 () {58 vars in 1415 bytes} [Wed May 25 07:39:58 2022] DELETE /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b/os-volume_attachments/2f9207fa-dc4c-455f-90c5-23e6a708ee5a => generated 0 bytes in 385 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:39:59.348168 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-4db6059d-3dc0-4af2-af57-22e791df1632 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:59.349166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-4db6059d-3dc0-4af2-af57-22e791df1632 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:59.355858 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4db6059d-3dc0-4af2-af57-22e791df1632 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:59.356299 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4db6059d-3dc0-4af2-af57-22e791df1632 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:59.357090 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4db6059d-3dc0-4af2-af57-22e791df1632 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:59.357520 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4db6059d-3dc0-4af2-af57-22e791df1632 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:59.387685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-4db6059d-3dc0-4af2-af57-22e791df1632 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044804 May 25 07:39:59.388298 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 201/420] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:39:59 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:39:59.970858 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-820ea3f8-f9ea-445f-8eeb-75dd5ad777e3 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:39:59.974326 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-820ea3f8-f9ea-445f-8eeb-75dd5ad777e3 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:39:59.978671 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-820ea3f8-f9ea-445f-8eeb-75dd5ad777e3 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:59.979158 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-820ea3f8-f9ea-445f-8eeb-75dd5ad777e3 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:39:59.979927 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-820ea3f8-f9ea-445f-8eeb-75dd5ad777e3 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:39:59.980366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-820ea3f8-f9ea-445f-8eeb-75dd5ad777e3 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:00.089030 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-54842cd5-01db-43d8-9b4f-5e6f9a25195e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:00.089799 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-54842cd5-01db-43d8-9b4f-5e6f9a25195e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:00.092294 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=73,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:00.115343 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-820ea3f8-f9ea-445f-8eeb-75dd5ad777e3 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:00.124534 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-820ea3f8-f9ea-445f-8eeb-75dd5ad777e3 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1733 microversion: 2.1 time: 0.158655 May 25 07:40:00.129386 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 220/421] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:39:59 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1733 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:00.148679 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-54842cd5-01db-43d8-9b4f-5e6f9a25195e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:00.155701 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-54842cd5-01db-43d8-9b4f-5e6f9a25195e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1088 microversion: 2.1 time: 0.072148 May 25 07:40:00.156274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 202/422] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:00 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1088 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:00.338701 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-f4f1661b-1077-4eee-8b79-3d5ac9200102 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:00.339202 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-f4f1661b-1077-4eee-8b79-3d5ac9200102 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:00.345198 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f4f1661b-1077-4eee-8b79-3d5ac9200102 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:00.345656 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f4f1661b-1077-4eee-8b79-3d5ac9200102 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:00.346421 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f4f1661b-1077-4eee-8b79-3d5ac9200102 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:00.346866 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f4f1661b-1077-4eee-8b79-3d5ac9200102 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:00.401788 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7832585b-3d96-4f6a-aaba-8c73ecb6b70a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:00.402956 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-7832585b-3d96-4f6a-aaba-8c73ecb6b70a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:00.410453 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7832585b-3d96-4f6a-aaba-8c73ecb6b70a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:00.410911 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7832585b-3d96-4f6a-aaba-8c73ecb6b70a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:00.411685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7832585b-3d96-4f6a-aaba-8c73ecb6b70a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:00.412125 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7832585b-3d96-4f6a-aaba-8c73ecb6b70a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:00.431962 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.objects.instance [None req-f4f1661b-1077-4eee-8b79-3d5ac9200102 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lazy-loading 'services' on Instance uuid a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 {{(pid=124675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:40:00.446892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-7832585b-3d96-4f6a-aaba-8c73ecb6b70a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050951 May 25 07:40:00.447662 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 203/423] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:40:00 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:40:00.617067 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-f4f1661b-1077-4eee-8b79-3d5ac9200102 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25/os-volume_attachments/522fc832-a130-4f97-b5c2-708bac0d5a96" status: 202 len: 0 microversion: 2.1 time: 0.282270 May 25 07:40:00.617745 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 221/424] 10.222.0.24 () {58 vars in 1415 bytes} [Wed May 25 07:40:00 2022] DELETE /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25/os-volume_attachments/522fc832-a130-4f97-b5c2-708bac0d5a96 => generated 0 bytes in 284 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:40:01.143713 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-0dcc20f2-9718-4f15-9b18-b82ea690b311 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:01.144724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-0dcc20f2-9718-4f15-9b18-b82ea690b311 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:01.152205 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0dcc20f2-9718-4f15-9b18-b82ea690b311 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:01.153326 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0dcc20f2-9718-4f15-9b18-b82ea690b311 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:01.154102 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0dcc20f2-9718-4f15-9b18-b82ea690b311 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:01.154536 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0dcc20f2-9718-4f15-9b18-b82ea690b311 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:01.173719 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-af77d4b2-3448-4cb7-b735-df16c4cfdb61 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:01.174648 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-af77d4b2-3448-4cb7-b735-df16c4cfdb61 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:01.181629 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-af77d4b2-3448-4cb7-b735-df16c4cfdb61 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:01.182173 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-af77d4b2-3448-4cb7-b735-df16c4cfdb61 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:01.183178 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-af77d4b2-3448-4cb7-b735-df16c4cfdb61 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:01.183946 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-af77d4b2-3448-4cb7-b735-df16c4cfdb61 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:01.255516 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-af77d4b2-3448-4cb7-b735-df16c4cfdb61 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:01.263770 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-af77d4b2-3448-4cb7-b735-df16c4cfdb61 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1186 microversion: 2.1 time: 0.094985 May 25 07:40:01.264704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 222/425] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:01 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1186 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:01.294886 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-0dcc20f2-9718-4f15-9b18-b82ea690b311 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:01.304333 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-0dcc20f2-9718-4f15-9b18-b82ea690b311 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1733 microversion: 2.1 time: 0.165650 May 25 07:40:01.304933 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 204/426] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:01 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1733 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:01.458597 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-051e0e96-4dce-4c8f-a3bd-8d981555a638 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:01.459808 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-051e0e96-4dce-4c8f-a3bd-8d981555a638 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:01.465729 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-051e0e96-4dce-4c8f-a3bd-8d981555a638 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:01.466178 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-051e0e96-4dce-4c8f-a3bd-8d981555a638 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:01.466942 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-051e0e96-4dce-4c8f-a3bd-8d981555a638 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:01.467376 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-051e0e96-4dce-4c8f-a3bd-8d981555a638 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:01.495876 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-051e0e96-4dce-4c8f-a3bd-8d981555a638 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041402 May 25 07:40:01.496426 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 223/427] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:40:01 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 07:40:01.554198 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-38feaa5f-bcd4-4216-9633-b75b79dc1b9f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:01.554600 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-38feaa5f-bcd4-4216-9633-b75b79dc1b9f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:01.560498 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-38feaa5f-bcd4-4216-9633-b75b79dc1b9f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:01.560956 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-38feaa5f-bcd4-4216-9633-b75b79dc1b9f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:01.561729 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-38feaa5f-bcd4-4216-9633-b75b79dc1b9f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:01.562170 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-38feaa5f-bcd4-4216-9633-b75b79dc1b9f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:01.587966 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-38feaa5f-bcd4-4216-9633-b75b79dc1b9f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Going to try to terminate instance {{(pid=124674) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:40:01.882233 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-38feaa5f-bcd4-4216-9633-b75b79dc1b9f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 204 len: 0 microversion: 2.1 time: 0.331410 May 25 07:40:01.885711 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 205/428] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:40:01 2022] DELETE /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 07:40:01.890856 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-23d2912a-b71b-4736-baf9-5f385d388868 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:01.891472 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-23d2912a-b71b-4736-baf9-5f385d388868 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:01.897606 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-23d2912a-b71b-4736-baf9-5f385d388868 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:01.898051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-23d2912a-b71b-4736-baf9-5f385d388868 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:01.898818 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-23d2912a-b71b-4736-baf9-5f385d388868 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:01.899254 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-23d2912a-b71b-4736-baf9-5f385d388868 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:02.124211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-23d2912a-b71b-4736-baf9-5f385d388868 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:02.132282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-23d2912a-b71b-4736-baf9-5f385d388868 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1678 microversion: 2.1 time: 0.244783 May 25 07:40:02.132891 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 224/429] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:01 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1678 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:02.282371 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-75d59b70-2c0c-488c-b31b-0b2921a47358 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:02.282993 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-75d59b70-2c0c-488c-b31b-0b2921a47358 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:02.290487 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-75d59b70-2c0c-488c-b31b-0b2921a47358 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:02.290935 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-75d59b70-2c0c-488c-b31b-0b2921a47358 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:02.291704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-75d59b70-2c0c-488c-b31b-0b2921a47358 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:02.292144 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-75d59b70-2c0c-488c-b31b-0b2921a47358 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:02.321654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-cbff3996-f9fd-465c-abeb-0e97cbcc4c73 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:02.322263 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-cbff3996-f9fd-465c-abeb-0e97cbcc4c73 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:02.328778 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cbff3996-f9fd-465c-abeb-0e97cbcc4c73 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:02.329233 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cbff3996-f9fd-465c-abeb-0e97cbcc4c73 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:02.330000 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cbff3996-f9fd-465c-abeb-0e97cbcc4c73 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:02.330436 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cbff3996-f9fd-465c-abeb-0e97cbcc4c73 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:02.358070 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-75d59b70-2c0c-488c-b31b-0b2921a47358 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:02.366030 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-75d59b70-2c0c-488c-b31b-0b2921a47358 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1204 microversion: 2.1 time: 0.088001 May 25 07:40:02.366717 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 206/430] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:02 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1204 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:02.461308 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-cbff3996-f9fd-465c-abeb-0e97cbcc4c73 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:02.469166 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-cbff3996-f9fd-465c-abeb-0e97cbcc4c73 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1733 microversion: 2.1 time: 0.151421 May 25 07:40:02.469730 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 225/431] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:02 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:02.788536 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-42c72e8d-f838-45e8-b33a-3c5cd657ebbd tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:40:02.794634 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-42c72e8d-f838-45e8-b33a-3c5cd657ebbd tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:02.795092 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-42c72e8d-f838-45e8-b33a-3c5cd657ebbd tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:02.816892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-42c72e8d-f838-45e8-b33a-3c5cd657ebbd tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Going to try to stop instance {{(pid=124674) force_stop /opt/stack/nova/nova/compute/api.py:2707}} May 25 07:40:03.007492 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-42c72e8d-f838-45e8-b33a-3c5cd657ebbd tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "POST /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25/action" status: 202 len: 0 microversion: 2.1 time: 0.223222 May 25 07:40:03.008093 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 207/432] 10.222.0.24 () {60 vars in 1277 bytes} [Wed May 25 07:40:02 2022] POST /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:40:03.016634 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-92f63275-4fa9-4d3b-9477-9238f7ead772 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:03.019965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-92f63275-4fa9-4d3b-9477-9238f7ead772 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:03.023909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-92f63275-4fa9-4d3b-9477-9238f7ead772 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:03.024376 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-92f63275-4fa9-4d3b-9477-9238f7ead772 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:03.025307 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-92f63275-4fa9-4d3b-9477-9238f7ead772 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:03.025746 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-92f63275-4fa9-4d3b-9477-9238f7ead772 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:03.150553 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-dc607148-2a05-45b2-b465-853edb664ffb tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:03.151637 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-dc607148-2a05-45b2-b465-853edb664ffb tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:03.155314 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-92f63275-4fa9-4d3b-9477-9238f7ead772 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:03.158126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-dc607148-2a05-45b2-b465-853edb664ffb tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:03.158579 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-dc607148-2a05-45b2-b465-853edb664ffb tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:03.159356 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-dc607148-2a05-45b2-b465-853edb664ffb tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:03.159794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-dc607148-2a05-45b2-b465-853edb664ffb tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:03.163098 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-92f63275-4fa9-4d3b-9477-9238f7ead772 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1677 microversion: 2.1 time: 0.150645 May 25 07:40:03.163675 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 226/433] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:03 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1677 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:03.289632 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-dc607148-2a05-45b2-b465-853edb664ffb tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:03.297056 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-dc607148-2a05-45b2-b465-853edb664ffb tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1678 microversion: 2.1 time: 0.151420 May 25 07:40:03.297619 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 208/434] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:03 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:03.383555 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-c2a3a0a7-2720-4e6c-af66-c7b510d7c303 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:03.384173 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-c2a3a0a7-2720-4e6c-af66-c7b510d7c303 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:03.390750 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c2a3a0a7-2720-4e6c-af66-c7b510d7c303 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:03.391213 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c2a3a0a7-2720-4e6c-af66-c7b510d7c303 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:03.392839 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c2a3a0a7-2720-4e6c-af66-c7b510d7c303 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:03.393646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c2a3a0a7-2720-4e6c-af66-c7b510d7c303 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:03.467616 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-c2a3a0a7-2720-4e6c-af66-c7b510d7c303 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:03.475600 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-c2a3a0a7-2720-4e6c-af66-c7b510d7c303 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1204 microversion: 2.1 time: 0.096529 May 25 07:40:03.477712 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 227/435] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:03 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1204 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:03.487075 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-2493da11-a832-411a-b2d5-7e4c49c6f431 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:03.487690 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-2493da11-a832-411a-b2d5-7e4c49c6f431 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:03.493703 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2493da11-a832-411a-b2d5-7e4c49c6f431 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:03.494155 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2493da11-a832-411a-b2d5-7e4c49c6f431 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:03.495032 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2493da11-a832-411a-b2d5-7e4c49c6f431 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:03.495560 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2493da11-a832-411a-b2d5-7e4c49c6f431 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:03.499641 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:03.626553 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-2493da11-a832-411a-b2d5-7e4c49c6f431 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:03.635206 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-2493da11-a832-411a-b2d5-7e4c49c6f431 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1733 microversion: 2.1 time: 0.152287 May 25 07:40:03.635770 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 209/436] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:03 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1733 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:04.181805 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-7f994239-5cc7-43e9-b372-45ff107f7b22 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:04.182507 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-7f994239-5cc7-43e9-b372-45ff107f7b22 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:04.190028 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7f994239-5cc7-43e9-b372-45ff107f7b22 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:04.190379 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7f994239-5cc7-43e9-b372-45ff107f7b22 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:04.191254 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7f994239-5cc7-43e9-b372-45ff107f7b22 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:04.191770 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7f994239-5cc7-43e9-b372-45ff107f7b22 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:04.314793 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-53ce7183-70c2-4f82-9539-0183d7c7b0c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:04.316076 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-53ce7183-70c2-4f82-9539-0183d7c7b0c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:04.323374 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-53ce7183-70c2-4f82-9539-0183d7c7b0c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:04.324206 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-53ce7183-70c2-4f82-9539-0183d7c7b0c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:04.325458 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-53ce7183-70c2-4f82-9539-0183d7c7b0c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:04.326121 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-53ce7183-70c2-4f82-9539-0183d7c7b0c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:04.417454 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-7f994239-5cc7-43e9-b372-45ff107f7b22 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:04.425244 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-7f994239-5cc7-43e9-b372-45ff107f7b22 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1677 microversion: 2.1 time: 0.248310 May 25 07:40:04.426175 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 228/437] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:04 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1677 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:04.493063 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-6a8363fb-d23e-44c6-9b37-03c04080fc40 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:04.493681 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-6a8363fb-d23e-44c6-9b37-03c04080fc40 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:04.499726 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6a8363fb-d23e-44c6-9b37-03c04080fc40 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:04.500185 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6a8363fb-d23e-44c6-9b37-03c04080fc40 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:04.501068 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6a8363fb-d23e-44c6-9b37-03c04080fc40 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:04.501512 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6a8363fb-d23e-44c6-9b37-03c04080fc40 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:04.572347 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-53ce7183-70c2-4f82-9539-0183d7c7b0c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:04.589630 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-53ce7183-70c2-4f82-9539-0183d7c7b0c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1678 microversion: 2.1 time: 0.278602 May 25 07:40:04.602325 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 210/438] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:04 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1678 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:04.655013 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-01257e07-30a8-4464-a6f9-8d4bd4f46690 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:04.658165 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-01257e07-30a8-4464-a6f9-8d4bd4f46690 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:04.665775 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-01257e07-30a8-4464-a6f9-8d4bd4f46690 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:04.666560 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-01257e07-30a8-4464-a6f9-8d4bd4f46690 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:04.667677 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-01257e07-30a8-4464-a6f9-8d4bd4f46690 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:04.668325 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-01257e07-30a8-4464-a6f9-8d4bd4f46690 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:04.724539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-6a8363fb-d23e-44c6-9b37-03c04080fc40 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:04.732933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-6a8363fb-d23e-44c6-9b37-03c04080fc40 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1271 microversion: 2.1 time: 0.243755 May 25 07:40:04.733519 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 229/439] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:04 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1271 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:04.811351 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-01257e07-30a8-4464-a6f9-8d4bd4f46690 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:04.821204 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-01257e07-30a8-4464-a6f9-8d4bd4f46690 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1733 microversion: 2.1 time: 0.172333 May 25 07:40:04.831645 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 211/440] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:04 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1733 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:05.134552 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-4d475ced-efc9-4a41-b4ce-fe8de523256e req-3cb21d08-2e70-4a2a-b324-8c561fa2a692 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f7f15090-8fe0-4ebd-b4e6-2aad101f417b", "name": "network-vif-deleted", "tag": "8914df61-0be3-41f5-849d-98c808f21db2"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:40:05.143031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-4d475ced-efc9-4a41-b4ce-fe8de523256e req-3cb21d08-2e70-4a2a-b324-8c561fa2a692 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:05.144403 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-4d475ced-efc9-4a41-b4ce-fe8de523256e req-3cb21d08-2e70-4a2a-b324-8c561fa2a692 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:05.156863 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-4d475ced-efc9-4a41-b4ce-fe8de523256e req-3cb21d08-2e70-4a2a-b324-8c561fa2a692 service nova] Creating event network-vif-deleted:8914df61-0be3-41f5-849d-98c808f21db2 for instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b on hv-cinder-82549 May 25 07:40:05.162334 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-4d475ced-efc9-4a41-b4ce-fe8de523256e req-3cb21d08-2e70-4a2a-b324-8c561fa2a692 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032222 May 25 07:40:05.163749 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 230/441] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:40:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:40:05.446261 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-9ab1505a-5d6e-46c3-8846-0c23fefc9be4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:05.446912 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-9ab1505a-5d6e-46c3-8846-0c23fefc9be4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:05.454471 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9ab1505a-5d6e-46c3-8846-0c23fefc9be4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:05.455580 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9ab1505a-5d6e-46c3-8846-0c23fefc9be4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:05.455714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9ab1505a-5d6e-46c3-8846-0c23fefc9be4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:05.456098 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9ab1505a-5d6e-46c3-8846-0c23fefc9be4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:05.610873 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-07bd3d19-1c4b-43e5-9596-6df94e1c2ae4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:05.611641 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-07bd3d19-1c4b-43e5-9596-6df94e1c2ae4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:05.629364 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9ab1505a-5d6e-46c3-8846-0c23fefc9be4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:05.633853 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-07bd3d19-1c4b-43e5-9596-6df94e1c2ae4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:05.634317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-07bd3d19-1c4b-43e5-9596-6df94e1c2ae4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:05.636309 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-07bd3d19-1c4b-43e5-9596-6df94e1c2ae4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:05.636795 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-07bd3d19-1c4b-43e5-9596-6df94e1c2ae4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:05.639560 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-9ab1505a-5d6e-46c3-8846-0c23fefc9be4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1677 microversion: 2.1 time: 0.199705 May 25 07:40:05.655546 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 212/442] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:05 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1677 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:05.750694 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-3e6d9ab2-c317-4500-aabb-cd86faf9aa60 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:05.751423 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-3e6d9ab2-c317-4500-aabb-cd86faf9aa60 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:05.752662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-07bd3d19-1c4b-43e5-9596-6df94e1c2ae4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:05.765025 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3e6d9ab2-c317-4500-aabb-cd86faf9aa60 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:05.765468 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-07bd3d19-1c4b-43e5-9596-6df94e1c2ae4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1323 microversion: 2.1 time: 0.161541 May 25 07:40:05.766271 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3e6d9ab2-c317-4500-aabb-cd86faf9aa60 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:05.768767 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3e6d9ab2-c317-4500-aabb-cd86faf9aa60 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:05.770672 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3e6d9ab2-c317-4500-aabb-cd86faf9aa60 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:05.773473 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 231/443] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:05 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1323 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:05.841836 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-c25ab871-4468-4651-a2f3-3570809f334b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:05.842867 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-c25ab871-4468-4651-a2f3-3570809f334b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:05.852191 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c25ab871-4468-4651-a2f3-3570809f334b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:05.865247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c25ab871-4468-4651-a2f3-3570809f334b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:05.866750 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c25ab871-4468-4651-a2f3-3570809f334b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:05.867205 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c25ab871-4468-4651-a2f3-3570809f334b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:05.955843 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-3e6d9ab2-c317-4500-aabb-cd86faf9aa60 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:05.965412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-3e6d9ab2-c317-4500-aabb-cd86faf9aa60 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1271 microversion: 2.1 time: 0.219683 May 25 07:40:05.966864 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 213/444] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:05 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1271 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:06.057070 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-c46373e5-89b3-48f1-9e7c-26b269243421 req-786d08a8-e495-4d55-a7f9-ddd1d5ab2caf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63430b83-f298-430c-9ca9-bdd4d69bde91", "tag": "6d5abc91-52ce-441e-be4e-749082dec7ae"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:40:06.071408 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-c46373e5-89b3-48f1-9e7c-26b269243421 req-786d08a8-e495-4d55-a7f9-ddd1d5ab2caf service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:06.073857 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-c46373e5-89b3-48f1-9e7c-26b269243421 req-786d08a8-e495-4d55-a7f9-ddd1d5ab2caf service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:06.082854 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-c25ab871-4468-4651-a2f3-3570809f334b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:06.088242 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-c46373e5-89b3-48f1-9e7c-26b269243421 req-786d08a8-e495-4d55-a7f9-ddd1d5ab2caf service nova] Creating event network-changed:6d5abc91-52ce-441e-be4e-749082dec7ae for instance 63430b83-f298-430c-9ca9-bdd4d69bde91 on hv-cinder-82549 May 25 07:40:06.093062 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-c46373e5-89b3-48f1-9e7c-26b269243421 req-786d08a8-e495-4d55-a7f9-ddd1d5ab2caf service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053208 May 25 07:40:06.093312 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-c25ab871-4468-4651-a2f3-3570809f334b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1733 microversion: 2.1 time: 0.256543 May 25 07:40:06.093658 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 214/445] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:40:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:40:06.104684 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 232/446] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:05 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1733 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:06.666100 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-479acd44-e2c5-4f3e-9999-31e9224a95bc tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:06.667582 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-479acd44-e2c5-4f3e-9999-31e9224a95bc tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:06.674924 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-479acd44-e2c5-4f3e-9999-31e9224a95bc tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:06.675377 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-479acd44-e2c5-4f3e-9999-31e9224a95bc tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:06.676192 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-479acd44-e2c5-4f3e-9999-31e9224a95bc tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:06.676608 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-479acd44-e2c5-4f3e-9999-31e9224a95bc tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:06.783312 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-e3fc6668-17ca-43dd-8ac2-c06d6030c1d0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:06.783968 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-e3fc6668-17ca-43dd-8ac2-c06d6030c1d0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:06.790361 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e3fc6668-17ca-43dd-8ac2-c06d6030c1d0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:06.790814 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e3fc6668-17ca-43dd-8ac2-c06d6030c1d0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:06.791584 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e3fc6668-17ca-43dd-8ac2-c06d6030c1d0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:06.792223 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e3fc6668-17ca-43dd-8ac2-c06d6030c1d0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:06.809175 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:06.812056 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-479acd44-e2c5-4f3e-9999-31e9224a95bc tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:06.821924 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-479acd44-e2c5-4f3e-9999-31e9224a95bc tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1677 microversion: 2.1 time: 0.165971 May 25 07:40:06.822762 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 215/447] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:06 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1677 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:06.830222 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e3fc6668-17ca-43dd-8ac2-c06d6030c1d0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:06.830222 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e3fc6668-17ca-43dd-8ac2-c06d6030c1d0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:06.830222 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.objects.instance [None req-e3fc6668-17ca-43dd-8ac2-c06d6030c1d0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lazy-loading 'fault' on Instance uuid f7f15090-8fe0-4ebd-b4e6-2aad101f417b {{(pid=124675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:40:06.872569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-e3fc6668-17ca-43dd-8ac2-c06d6030c1d0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:06.879912 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-e3fc6668-17ca-43dd-8ac2-c06d6030c1d0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 200 len: 1328 microversion: 2.1 time: 0.100541 May 25 07:40:06.880501 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 233/448] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:06 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 1328 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:06.982362 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-ccbc2fdf-8a3c-4095-8013-a3a1e370245d tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:06.982970 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-ccbc2fdf-8a3c-4095-8013-a3a1e370245d tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:06.989297 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ccbc2fdf-8a3c-4095-8013-a3a1e370245d tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:06.989740 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ccbc2fdf-8a3c-4095-8013-a3a1e370245d tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:06.990504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ccbc2fdf-8a3c-4095-8013-a3a1e370245d tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:06.990933 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ccbc2fdf-8a3c-4095-8013-a3a1e370245d tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:07.111983 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b7abe717-fbbb-4b35-9b0d-cf4121b61aab tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:07.112732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b7abe717-fbbb-4b35-9b0d-cf4121b61aab tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:07.121077 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b7abe717-fbbb-4b35-9b0d-cf4121b61aab tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:07.121541 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b7abe717-fbbb-4b35-9b0d-cf4121b61aab tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:07.122325 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b7abe717-fbbb-4b35-9b0d-cf4121b61aab tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:07.122540 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-ccbc2fdf-8a3c-4095-8013-a3a1e370245d tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:07.122770 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b7abe717-fbbb-4b35-9b0d-cf4121b61aab tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:07.130367 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-ccbc2fdf-8a3c-4095-8013-a3a1e370245d tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1259 microversion: 2.1 time: 0.151853 May 25 07:40:07.131315 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 216/449] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:06 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1259 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:07.256065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b7abe717-fbbb-4b35-9b0d-cf4121b61aab tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:07.264817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b7abe717-fbbb-4b35-9b0d-cf4121b61aab tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1713 microversion: 2.1 time: 0.156941 May 25 07:40:07.265477 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 234/450] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:07 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1713 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:07.377247 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-828ee439-3bbd-4b4b-849d-53c961b5ecc9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:07.377744 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-828ee439-3bbd-4b4b-849d-53c961b5ecc9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:07.384867 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-828ee439-3bbd-4b4b-849d-53c961b5ecc9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:07.384867 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-828ee439-3bbd-4b4b-849d-53c961b5ecc9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:07.385120 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-828ee439-3bbd-4b4b-849d-53c961b5ecc9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:07.385564 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-828ee439-3bbd-4b4b-849d-53c961b5ecc9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:07.517794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-828ee439-3bbd-4b4b-849d-53c961b5ecc9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] HTTP exception thrown: Cannot 'detach_volume' instance a5ef563c-52c0-40b3-bdf3-dc51e5422196 while it is in vm_state rescued May 25 07:40:07.519411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-828ee439-3bbd-4b4b-849d-53c961b5ecc9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Request method failure captured: May 25 07:40:07.519411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: DELETE /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196/os-volume_attachments/fc32bf61-1ed8-421a-8a0d-533a1c6a23d5 HTTP/1.1 May 25 07:40:07.519411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:40:07.519411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:40:07.519411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:40:07.519411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:40:07.519411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:40:07.519411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:40:07.519411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:40:07.519411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:40:07.519411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdyGuqDe3p06hkpp6ohyIkCZkEMZD-Xm9k8dFGeecHnJxdqekCaABg8wzmfOAlxn-W8UpasXr7XYWqwQfoR7IZRkPp3JQjBoqqqadXk1ODtfCJewTnu7WrLyB1br2CZbFtQzX_dfu8qpnIIdjcBpxB5N_NNozK67UOqIu_ddo6FZg-U May 25 07:40:07.519411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:40:07.519411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:40:07.519411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:40:07.519411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:40:07.519411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:40:07.519411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:40:07.519411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: d4719a4804e24f27b9427e58c5cbe13b May 25 07:40:07.519411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-274124411 May 25 07:40:07.519411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:40:07.519411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:40:07.521010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d4719a4804e24f27b9427e58c5cbe13b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/d4719a4804e24f27b9427e58c5cbe13b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_d4719a4804e24f27b9427e58c5cbe13b", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d4719a4804e24f27b9427e58c5cbe13b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:40:07.521010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-ServerRescueNegativeTestJSON-274124411 May 25 07:40:07.521010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: d4719a4804e24f27b9427e58c5cbe13b May 25 07:40:07.521010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-274124411 May 25 07:40:07.521010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-ServerRescueNegativeTestJSON-274124411-project May 25 07:40:07.521010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:40:07.521010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:40:07.521010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: f90f0f6afda54e80bc319dc5bdb80ea6 May 25 07:40:07.521010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-ServerRescueNegativeTestJSON-274124411-project May 25 07:40:07.521010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:40:07.521010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Cannot 'detach_volume' instance a5ef563c-52c0-40b3-bdf3-dc51e5422196 while it is in vm_state rescued May 25 07:40:07.521845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'server_id': 'a5ef563c-52c0-40b3-bdf3-dc51e5422196', 'id': 'fc32bf61-1ed8-421a-8a0d-533a1c6a23d5'} May 25 07:40:07.521845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:40:07.521845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:40:07.521845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete May 25 07:40:07.521845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) May 25 07:40:07.521845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 07:40:07.521845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 07:40:07.521845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner May 25 07:40:07.521845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( May 25 07:40:07.521845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a5ef563c-52c0-40b3-bdf3-dc51e5422196 in vm_state rescued. Cannot detach_volume while the instance is in this state. May 25 07:40:07.521845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:40:07.521845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:40:07.521845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:40:07.521845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:40:07.521845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:40:07.521845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:40:07.521845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:40:07.521845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:40:07.521845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:40:07.521845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:40:07.523851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete May 25 07:40:07.523851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, May 25 07:40:07.523851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state May 25 07:40:07.523851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) May 25 07:40:07.523851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a5ef563c-52c0-40b3-bdf3-dc51e5422196 while it is in vm_state rescued May 25 07:40:07.523851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:40:07.523851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:40:07.523851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:40:07.523851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:40:07.523851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:40:07.523851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:40:07.523851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:40:07.523851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:40:07.523851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a5ef563c-52c0-40b3-bdf3-dc51e5422196 while it is in vm_state rescued May 25 07:40:07.523851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:40:07.523851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-828ee439-3bbd-4b4b-849d-53c961b5ecc9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Returning 409 to user: Cannot 'detach_volume' instance a5ef563c-52c0-40b3-bdf3-dc51e5422196 while it is in vm_state rescued {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:40:07.525054 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-828ee439-3bbd-4b4b-849d-53c961b5ecc9 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196/os-volume_attachments/fc32bf61-1ed8-421a-8a0d-533a1c6a23d5" status: 409 len: 152 microversion: 2.1 time: 0.147917 May 25 07:40:07.525054 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 217/451] 10.222.0.24 () {58 vars in 1415 bytes} [Wed May 25 07:40:07 2022] DELETE /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196/os-volume_attachments/fc32bf61-1ed8-421a-8a0d-533a1c6a23d5 => generated 152 bytes in 149 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) May 25 07:40:07.531032 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ebbf27f4-2436-49ca-9fda-01dd58c4a216 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:40:07.531770 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ebbf27f4-2436-49ca-9fda-01dd58c4a216 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:07.538976 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ebbf27f4-2436-49ca-9fda-01dd58c4a216 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:07.539435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ebbf27f4-2436-49ca-9fda-01dd58c4a216 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:07.540219 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ebbf27f4-2436-49ca-9fda-01dd58c4a216 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:07.540692 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ebbf27f4-2436-49ca-9fda-01dd58c4a216 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:07.787516 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ebbf27f4-2436-49ca-9fda-01dd58c4a216 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "POST /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196/action" status: 202 len: 0 microversion: 2.1 time: 0.260686 May 25 07:40:07.788811 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 235/452] 10.222.0.24 () {60 vars in 1277 bytes} [Wed May 25 07:40:07 2022] POST /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196/action => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:40:07.797630 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-a54716c7-3a27-41c1-b137-b8020741727a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:07.797630 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-a54716c7-3a27-41c1-b137-b8020741727a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:07.806006 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a54716c7-3a27-41c1-b137-b8020741727a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:07.806459 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a54716c7-3a27-41c1-b137-b8020741727a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:07.807252 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a54716c7-3a27-41c1-b137-b8020741727a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:07.807675 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a54716c7-3a27-41c1-b137-b8020741727a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:07.841650 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-59deb5b4-ac87-4a6f-883a-a7dde532a524 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:07.842937 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-59deb5b4-ac87-4a6f-883a-a7dde532a524 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:07.849887 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-59deb5b4-ac87-4a6f-883a-a7dde532a524 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:07.850844 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-59deb5b4-ac87-4a6f-883a-a7dde532a524 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:07.851625 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-59deb5b4-ac87-4a6f-883a-a7dde532a524 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:07.852055 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-59deb5b4-ac87-4a6f-883a-a7dde532a524 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:07.948255 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a54716c7-3a27-41c1-b137-b8020741727a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:07.957226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-a54716c7-3a27-41c1-b137-b8020741727a tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1721 microversion: 2.1 time: 0.164041 May 25 07:40:07.957846 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 218/453] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:07 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1721 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:07.962853 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-00858c03-7df7-4fe1-bb27-e3d62087746e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:07.964247 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-00858c03-7df7-4fe1-bb27-e3d62087746e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:07.970697 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-00858c03-7df7-4fe1-bb27-e3d62087746e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:07.971144 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-00858c03-7df7-4fe1-bb27-e3d62087746e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:07.971908 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-00858c03-7df7-4fe1-bb27-e3d62087746e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:07.981005 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-00858c03-7df7-4fe1-bb27-e3d62087746e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:07.989712 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-00858c03-7df7-4fe1-bb27-e3d62087746e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] HTTP exception thrown: Instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b could not be found. May 25 07:40:07.991835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-00858c03-7df7-4fe1-bb27-e3d62087746e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Request method failure captured: May 25 07:40:07.991835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b HTTP/1.1 May 25 07:40:07.991835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:40:07.991835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:40:07.991835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:40:07.991835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:40:07.991835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:40:07.991835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:40:07.991835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:40:07.991835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:40:07.991835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdyI17YkjQqKsTicl5BdlTZvAyQ_GMXlLJBh83Og-ZMS2KVi2Us0aJRqbM6uLQgUDMPeORhcs3ta8E3UdJWMvBXVjTqxdi2zYK0EmeD76I0JveUsx0Rz9WMLKSIeeZZQrA5vc_1CQNMm1pSzCady0n-o4b9yXkMaGi83bIjdMzlEcds May 25 07:40:07.991835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:40:07.991835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:40:07.991835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:40:07.991835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:40:07.991835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:40:07.991835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:40:07.991835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:40:07.991835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:40:07.991835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:40:07.991835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:40:07.993469 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2d8e35800ce043acbcb027ce406ed2e7", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:40:07.993469 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:40:07.993469 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:40:07.993469 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:40:07.993469 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:40:07.993469 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:40:07.993469 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:40:07.993469 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: 0487ea9076ee4baf8138fdc25ce02522 May 25 07:40:07.993469 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:40:07.993469 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:40:07.993469 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b could not be found. May 25 07:40:07.993469 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': 'f7f15090-8fe0-4ebd-b4e6-2aad101f417b'} May 25 07:40:07.994249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:40:07.994249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:40:07.994249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:40:07.994249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:40:07.994249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:40:07.994249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:40:07.994249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:40:07.994249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:40:07.994249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:40:07.994249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:40:07.994249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b could not be found. May 25 07:40:07.994249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:40:07.994249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:40:07.994249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:40:07.994249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:40:07.994249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:40:07.994249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:40:07.994249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:40:07.994249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:40:07.994249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:40:07.995676 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:40:07.995676 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:40:07.995676 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:40:07.995676 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:40:07.995676 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:40:07.995676 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:40:07.995676 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:40:07.995676 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b could not be found. May 25 07:40:07.995676 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:40:07.995676 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:40:07.995676 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:40:07.995676 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:40:07.995676 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:40:07.995676 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:40:07.995676 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:40:07.995676 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:40:07.995676 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b could not be found. May 25 07:40:07.995676 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:40:07.996969 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-00858c03-7df7-4fe1-bb27-e3d62087746e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Returning 404 to user: Instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:40:07.996969 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-00858c03-7df7-4fe1-bb27-e3d62087746e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 404 len: 111 microversion: 2.1 time: 0.034446 May 25 07:40:07.996969 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 219/454] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:07 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:40:08.000378 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-59deb5b4-ac87-4a6f-883a-a7dde532a524 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:08.001862 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-82532097-e112-4f11-8657-fda94bbafeeb tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '.version_select at 0x7fc86434bb80>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:08.008755 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-59deb5b4-ac87-4a6f-883a-a7dde532a524 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1677 microversion: 2.1 time: 0.173176 May 25 07:40:08.009333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 236/455] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:07 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1677 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:08.121996 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-82532097-e112-4f11-8657-fda94bbafeeb tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-96530937" status: 202 len: 0 microversion: 2.1 time: 0.123655 May 25 07:40:08.122670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 220/456] 10.222.0.24 () {58 vars in 1214 bytes} [Wed May 25 07:40:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-96530937 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 07:40:08.155986 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ceab52f9-e9b6-439d-bf07-1a4a1a6c6cbf tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:08.155986 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ceab52f9-e9b6-439d-bf07-1a4a1a6c6cbf tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:08.159310 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ceab52f9-e9b6-439d-bf07-1a4a1a6c6cbf tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:08.159768 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ceab52f9-e9b6-439d-bf07-1a4a1a6c6cbf tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:08.160712 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ceab52f9-e9b6-439d-bf07-1a4a1a6c6cbf tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:08.161157 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ceab52f9-e9b6-439d-bf07-1a4a1a6c6cbf tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:08.382312 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ceab52f9-e9b6-439d-bf07-1a4a1a6c6cbf tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:08.400065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ceab52f9-e9b6-439d-bf07-1a4a1a6c6cbf tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1259 microversion: 2.1 time: 0.252604 May 25 07:40:08.401044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 237/457] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:08 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1259 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:08.890562 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-63ce4a05-57d9-428d-a9c3-906bdfad9cd9 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Action: 'create', calling method: .version_select at 0x7fc864308e50>, body: {"keypair": {"name": "tempest-keypair-1865389899", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN1toXwM9aRTtGZ3FYSInj9nUQSB7eOJw2FSXNQ+OcuSArmTDC3ReVVQmTCMbgc1bhWtbvG2AhHbkL/h6DNQFktXAinbse0p//Ig6vKRi2t6I9ubo5PMDw83oNnm3qOj7A=="}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:40:08.894557 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=2 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:08.907172 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-63ce4a05-57d9-428d-a9c3-906bdfad9cd9 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Getting quotas for project 2d8e35800ce043acbcb027ce406ed2e7. Resources: {'key_pairs'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:40:08.910995 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-63ce4a05-57d9-428d-a9c3-906bdfad9cd9 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Getting quotas for user 0487ea9076ee4baf8138fdc25ce02522 and project 2d8e35800ce043acbcb027ce406ed2e7. Resources: {'key_pairs'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:40:08.989221 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-522346a6-1dd5-42b9-9303-34b90ec38c98 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:08.989745 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-522346a6-1dd5-42b9-9303-34b90ec38c98 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:08.996539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-522346a6-1dd5-42b9-9303-34b90ec38c98 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:08.997001 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-522346a6-1dd5-42b9-9303-34b90ec38c98 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:08.997769 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-522346a6-1dd5-42b9-9303-34b90ec38c98 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:08.998212 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-522346a6-1dd5-42b9-9303-34b90ec38c98 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:09.048038 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-63ce4a05-57d9-428d-a9c3-906bdfad9cd9 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.161318 May 25 07:40:09.052619 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 221/458] 10.222.0.24 () {60 vars in 1158 bytes} [Wed May 25 07:40:08 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:40:09.057935 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-ba97432b-bbdf-49fb-a853-806dcabed4d5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:09.057935 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-ba97432b-bbdf-49fb-a853-806dcabed4d5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:09.061022 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ba97432b-bbdf-49fb-a853-806dcabed4d5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:09.061702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ba97432b-bbdf-49fb-a853-806dcabed4d5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:09.062642 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ba97432b-bbdf-49fb-a853-806dcabed4d5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:09.063302 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ba97432b-bbdf-49fb-a853-806dcabed4d5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:09.136253 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-522346a6-1dd5-42b9-9303-34b90ec38c98 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:09.144569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-522346a6-1dd5-42b9-9303-34b90ec38c98 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1721 microversion: 2.1 time: 0.159364 May 25 07:40:09.145147 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 238/459] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:08 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:09.219850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-ba97432b-bbdf-49fb-a853-806dcabed4d5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:09.227496 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-ba97432b-bbdf-49fb-a853-806dcabed4d5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1677 microversion: 2.1 time: 0.177533 May 25 07:40:09.228354 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 222/460] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:09 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1677 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:09.417550 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-be1c88fc-6137-4f4e-9078-ff6e4e7b1f6e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:09.418201 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-be1c88fc-6137-4f4e-9078-ff6e4e7b1f6e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:09.424147 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-be1c88fc-6137-4f4e-9078-ff6e4e7b1f6e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:09.424703 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-be1c88fc-6137-4f4e-9078-ff6e4e7b1f6e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:09.425485 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-be1c88fc-6137-4f4e-9078-ff6e4e7b1f6e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:09.425924 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-be1c88fc-6137-4f4e-9078-ff6e4e7b1f6e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:09.556030 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-be1c88fc-6137-4f4e-9078-ff6e4e7b1f6e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:09.564041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-be1c88fc-6137-4f4e-9078-ff6e4e7b1f6e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1259 microversion: 2.1 time: 0.150232 May 25 07:40:09.567825 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 239/461] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:09 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1259 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:10.163491 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-13211d93-5cfa-4dfa-8653-462e431754b3 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:10.164758 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-13211d93-5cfa-4dfa-8653-462e431754b3 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:10.171728 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-13211d93-5cfa-4dfa-8653-462e431754b3 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:10.172284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-13211d93-5cfa-4dfa-8653-462e431754b3 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:10.175865 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-13211d93-5cfa-4dfa-8653-462e431754b3 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:10.175865 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-13211d93-5cfa-4dfa-8653-462e431754b3 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:10.246381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-616e9999-83ed-4fe0-94e9-4f32ceebfdd2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:10.247106 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-616e9999-83ed-4fe0-94e9-4f32ceebfdd2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:10.254038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-616e9999-83ed-4fe0-94e9-4f32ceebfdd2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:10.254571 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-616e9999-83ed-4fe0-94e9-4f32ceebfdd2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:10.255411 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-616e9999-83ed-4fe0-94e9-4f32ceebfdd2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:10.255981 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-616e9999-83ed-4fe0-94e9-4f32ceebfdd2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:10.393453 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-616e9999-83ed-4fe0-94e9-4f32ceebfdd2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:10.401211 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-13211d93-5cfa-4dfa-8653-462e431754b3 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:10.401467 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-616e9999-83ed-4fe0-94e9-4f32ceebfdd2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1677 microversion: 2.1 time: 0.159117 May 25 07:40:10.401832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 240/462] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:10 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1677 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:10.409402 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-13211d93-5cfa-4dfa-8653-462e431754b3 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1721 microversion: 2.1 time: 0.250603 May 25 07:40:10.410039 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 223/463] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:10 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1721 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:10.581004 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-d7db1d5a-b121-4314-a19e-ef196bace19f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:10.581621 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-d7db1d5a-b121-4314-a19e-ef196bace19f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:10.588147 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d7db1d5a-b121-4314-a19e-ef196bace19f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:10.588626 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d7db1d5a-b121-4314-a19e-ef196bace19f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:10.589411 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d7db1d5a-b121-4314-a19e-ef196bace19f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:10.589845 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d7db1d5a-b121-4314-a19e-ef196bace19f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:10.725131 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d7db1d5a-b121-4314-a19e-ef196bace19f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:10.733534 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-d7db1d5a-b121-4314-a19e-ef196bace19f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1259 microversion: 2.1 time: 0.156529 May 25 07:40:10.734103 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 241/464] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:10 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:11.418831 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-8b27f118-5bec-464f-aaf5-887166e9f700 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:11.419446 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-8b27f118-5bec-464f-aaf5-887166e9f700 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:11.426426 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8b27f118-5bec-464f-aaf5-887166e9f700 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:11.426882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8b27f118-5bec-464f-aaf5-887166e9f700 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:11.427033 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-439b65eb-8219-40c8-8ff2-043a464de4ae tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:11.427655 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8b27f118-5bec-464f-aaf5-887166e9f700 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:11.427764 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-439b65eb-8219-40c8-8ff2-043a464de4ae tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:11.428097 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8b27f118-5bec-464f-aaf5-887166e9f700 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:11.435236 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-439b65eb-8219-40c8-8ff2-043a464de4ae tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:11.435766 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-439b65eb-8219-40c8-8ff2-043a464de4ae tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:11.436766 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-439b65eb-8219-40c8-8ff2-043a464de4ae tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:11.437406 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-439b65eb-8219-40c8-8ff2-043a464de4ae tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:11.577190 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-439b65eb-8219-40c8-8ff2-043a464de4ae tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:11.586647 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-439b65eb-8219-40c8-8ff2-043a464de4ae tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1727 microversion: 2.1 time: 0.163731 May 25 07:40:11.591558 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 242/465] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:11 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1727 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:11.602522 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-8b27f118-5bec-464f-aaf5-887166e9f700 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:11.606773 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-965771fc-5a8a-4211-a37a-2ecca973dab6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:11.607265 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-965771fc-5a8a-4211-a37a-2ecca973dab6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:11.610613 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-8b27f118-5bec-464f-aaf5-887166e9f700 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1677 microversion: 2.1 time: 0.195822 May 25 07:40:11.611223 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 224/466] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:11 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1677 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:11.613890 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-965771fc-5a8a-4211-a37a-2ecca973dab6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:11.614341 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-965771fc-5a8a-4211-a37a-2ecca973dab6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:11.615109 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-965771fc-5a8a-4211-a37a-2ecca973dab6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:11.615543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-965771fc-5a8a-4211-a37a-2ecca973dab6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:11.695958 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-965771fc-5a8a-4211-a37a-2ecca973dab6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092991 May 25 07:40:11.696662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 243/467] 10.222.0.24 () {58 vars in 1274 bytes} [Wed May 25 07:40:11 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:40:11.751332 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-f96adc85-03e7-449e-8472-1329db8c97ed tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:11.751943 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-f96adc85-03e7-449e-8472-1329db8c97ed tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:11.758853 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f96adc85-03e7-449e-8472-1329db8c97ed tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:11.759307 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f96adc85-03e7-449e-8472-1329db8c97ed tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:11.760086 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f96adc85-03e7-449e-8472-1329db8c97ed tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:11.760605 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f96adc85-03e7-449e-8472-1329db8c97ed tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:11.907395 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-f96adc85-03e7-449e-8472-1329db8c97ed tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:11.917252 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-f96adc85-03e7-449e-8472-1329db8c97ed tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1259 microversion: 2.1 time: 0.169816 May 25 07:40:11.917830 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 225/468] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:11 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1259 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:11.939176 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-e970d71a-1a49-4494-90dc-3525cb83f684 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2109329059", "imageRef": "ddc5b622-a846-425a-b8fd-7e5caef00bf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f39d85d3-0173-4496-879c-2b83e234d364"}], "security_groups": [{"name": "tempest-securitygroup--686321304"}], "key_name": "tempest-keypair-1865389899", "user_data": "}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:40:12.122583 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.network.neutron [None req-e970d71a-1a49-4494-90dc-3525cb83f684 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] validate_networks() for [('f39d85d3-0173-4496-879c-2b83e234d364', None, None, None, None, None)] {{(pid=124675) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:40:12.628624 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1271c98f-c598-4db1-8a35-8595f67116f7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:12.629262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-1271c98f-c598-4db1-8a35-8595f67116f7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:12.636445 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1271c98f-c598-4db1-8a35-8595f67116f7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:12.636920 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1271c98f-c598-4db1-8a35-8595f67116f7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:12.637688 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1271c98f-c598-4db1-8a35-8595f67116f7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:12.638128 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1271c98f-c598-4db1-8a35-8595f67116f7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:12.775154 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1271c98f-c598-4db1-8a35-8595f67116f7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:12.783054 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-1271c98f-c598-4db1-8a35-8595f67116f7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1677 microversion: 2.1 time: 0.158282 May 25 07:40:12.786244 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 226/469] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:12 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:12.933915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-30876896-7cff-486a-be9e-f3217b7d7e87 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:12.934539 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-30876896-7cff-486a-be9e-f3217b7d7e87 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:12.940725 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-30876896-7cff-486a-be9e-f3217b7d7e87 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:12.941174 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-30876896-7cff-486a-be9e-f3217b7d7e87 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:12.941944 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-30876896-7cff-486a-be9e-f3217b7d7e87 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:12.942383 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-30876896-7cff-486a-be9e-f3217b7d7e87 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:12.994311 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-e970d71a-1a49-4494-90dc-3525cb83f684 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Flavor limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:40:12.994803 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-e970d71a-1a49-4494-90dc-3525cb83f684 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Image limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:40:12.995211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-e970d71a-1a49-4494-90dc-3525cb83f684 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Flavor pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:40:12.995628 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-e970d71a-1a49-4494-90dc-3525cb83f684 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Image pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:40:12.996047 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-e970d71a-1a49-4494-90dc-3525cb83f684 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:40:13.008300 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e970d71a-1a49-4494-90dc-3525cb83f684 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:13.008786 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e970d71a-1a49-4494-90dc-3525cb83f684 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:13.009853 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e970d71a-1a49-4494-90dc-3525cb83f684 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:13.010250 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e970d71a-1a49-4494-90dc-3525cb83f684 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:13.027868 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-e970d71a-1a49-4494-90dc-3525cb83f684 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Getting quotas for project 2d8e35800ce043acbcb027ce406ed2e7. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:40:13.046023 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-e970d71a-1a49-4494-90dc-3525cb83f684 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Getting quotas for user 0487ea9076ee4baf8138fdc25ce02522 and project 2d8e35800ce043acbcb027ce406ed2e7. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:40:13.062599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-e970d71a-1a49-4494-90dc-3525cb83f684 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Going to run 1 instances... {{(pid=124675) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:40:13.064982 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-e970d71a-1a49-4494-90dc-3525cb83f684 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddc5b622-a846-425a-b8fd-7e5caef00bf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:40:13.086357 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-30876896-7cff-486a-be9e-f3217b7d7e87 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:13.094129 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-30876896-7cff-486a-be9e-f3217b7d7e87 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1259 microversion: 2.1 time: 0.164061 May 25 07:40:13.094735 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 227/470] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:12 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1259 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:13.167663 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-c8e4b10f-aa04-4ebb-8355-6d1d22639ee5 req-6230f3e0-7d50-4ca1-bca9-9e1a0a461739 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5ef563c-52c0-40b3-bdf3-dc51e5422196", "tag": "0747a8fb-24f2-4911-87f0-c806befeeab7"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:40:13.176499 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-c8e4b10f-aa04-4ebb-8355-6d1d22639ee5 req-6230f3e0-7d50-4ca1-bca9-9e1a0a461739 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:13.176944 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-c8e4b10f-aa04-4ebb-8355-6d1d22639ee5 req-6230f3e0-7d50-4ca1-bca9-9e1a0a461739 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:13.195613 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-c8e4b10f-aa04-4ebb-8355-6d1d22639ee5 req-6230f3e0-7d50-4ca1-bca9-9e1a0a461739 service nova] Creating event network-changed:0747a8fb-24f2-4911-87f0-c806befeeab7 for instance a5ef563c-52c0-40b3-bdf3-dc51e5422196 on hv-cinder-82549 May 25 07:40:13.200922 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-c8e4b10f-aa04-4ebb-8355-6d1d22639ee5 req-6230f3e0-7d50-4ca1-bca9-9e1a0a461739 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036824 May 25 07:40:13.201642 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 228/471] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:40:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:40:13.244152 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-e970d71a-1a49-4494-90dc-3525cb83f684 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.309207 May 25 07:40:13.244977 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 244/472] 10.222.0.24 () {60 vars in 1146 bytes} [Wed May 25 07:40:11 2022] POST /compute/v2.1/servers => generated 401 bytes in 1311 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 07:40:13.257013 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-6cd8ad5a-4cd7-4fbd-97c8-705187499c26 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:13.257840 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-6cd8ad5a-4cd7-4fbd-97c8-705187499c26 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:13.316279 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-6cd8ad5a-4cd7-4fbd-97c8-705187499c26 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:13.323538 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-6cd8ad5a-4cd7-4fbd-97c8-705187499c26 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 200 len: 1242 microversion: 2.1 time: 0.070957 May 25 07:40:13.324300 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 229/473] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:13 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 1242 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:13.801534 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b58d089c-aa40-43d0-9e5d-59501eb284a6 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:13.802162 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b58d089c-aa40-43d0-9e5d-59501eb284a6 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:13.808503 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b58d089c-aa40-43d0-9e5d-59501eb284a6 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:13.808982 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b58d089c-aa40-43d0-9e5d-59501eb284a6 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:13.809758 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b58d089c-aa40-43d0-9e5d-59501eb284a6 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:13.810207 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b58d089c-aa40-43d0-9e5d-59501eb284a6 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:13.947479 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b58d089c-aa40-43d0-9e5d-59501eb284a6 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:13.955592 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b58d089c-aa40-43d0-9e5d-59501eb284a6 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1677 microversion: 2.1 time: 0.158414 May 25 07:40:13.956174 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 245/474] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:13 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1677 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:14.114916 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-50a0b14f-c888-414f-b348-27aaf4f70768 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:14.116512 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-50a0b14f-c888-414f-b348-27aaf4f70768 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:14.126120 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-50a0b14f-c888-414f-b348-27aaf4f70768 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:14.128677 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-50a0b14f-c888-414f-b348-27aaf4f70768 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:14.128677 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-50a0b14f-c888-414f-b348-27aaf4f70768 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:14.128677 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-50a0b14f-c888-414f-b348-27aaf4f70768 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:14.266054 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-50a0b14f-c888-414f-b348-27aaf4f70768 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:14.268327 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=100 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:14.275094 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-50a0b14f-c888-414f-b348-27aaf4f70768 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1259 microversion: 2.1 time: 0.167636 May 25 07:40:14.275880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 230/475] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:14 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1259 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:14.341372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-6abd409e-fdce-400c-b491-def97c6eb452 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:14.341986 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-6abd409e-fdce-400c-b491-def97c6eb452 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:14.348463 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6abd409e-fdce-400c-b491-def97c6eb452 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:14.348943 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6abd409e-fdce-400c-b491-def97c6eb452 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:14.349714 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6abd409e-fdce-400c-b491-def97c6eb452 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:14.350151 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6abd409e-fdce-400c-b491-def97c6eb452 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:14.423429 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-6abd409e-fdce-400c-b491-def97c6eb452 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:14.431234 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-6abd409e-fdce-400c-b491-def97c6eb452 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 200 len: 1246 microversion: 2.1 time: 0.093813 May 25 07:40:14.431816 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 246/476] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:14 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 1246 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:14.973968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-e21a93d1-cf71-40fa-8ea1-675957ec8bc3 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:14.974576 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-e21a93d1-cf71-40fa-8ea1-675957ec8bc3 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:14.980762 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e21a93d1-cf71-40fa-8ea1-675957ec8bc3 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:14.981269 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e21a93d1-cf71-40fa-8ea1-675957ec8bc3 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:14.982026 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e21a93d1-cf71-40fa-8ea1-675957ec8bc3 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:14.982457 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e21a93d1-cf71-40fa-8ea1-675957ec8bc3 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:15.111398 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-e21a93d1-cf71-40fa-8ea1-675957ec8bc3 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:15.119428 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-e21a93d1-cf71-40fa-8ea1-675957ec8bc3 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1654 microversion: 2.1 time: 0.149718 May 25 07:40:15.120002 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 231/477] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:14 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1654 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:15.136521 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-5cfe3a21-d166-43e5-8bfc-6183a7cc9b0f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:40:15.142834 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5cfe3a21-d166-43e5-8bfc-6183a7cc9b0f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:15.143291 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5cfe3a21-d166-43e5-8bfc-6183a7cc9b0f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:15.202764 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-5cfe3a21-d166-43e5-8bfc-6183a7cc9b0f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Going to try to start instance {{(pid=124675) start /opt/stack/nova/nova/compute/api.py:2730}} May 25 07:40:15.215075 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-4787a90f-91e5-4f00-a976-1977c0a80e3d req-bd10fc2d-86e3-4f2b-bf9c-e4add9736876 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5ef563c-52c0-40b3-bdf3-dc51e5422196", "tag": "0747a8fb-24f2-4911-87f0-c806befeeab7"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:40:15.223466 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-4787a90f-91e5-4f00-a976-1977c0a80e3d req-bd10fc2d-86e3-4f2b-bf9c-e4add9736876 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:15.223911 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-4787a90f-91e5-4f00-a976-1977c0a80e3d req-bd10fc2d-86e3-4f2b-bf9c-e4add9736876 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:15.241519 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-4787a90f-91e5-4f00-a976-1977c0a80e3d req-bd10fc2d-86e3-4f2b-bf9c-e4add9736876 service nova] Creating event network-changed:0747a8fb-24f2-4911-87f0-c806befeeab7 for instance a5ef563c-52c0-40b3-bdf3-dc51e5422196 on hv-cinder-82549 May 25 07:40:15.242389 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-4787a90f-91e5-4f00-a976-1977c0a80e3d req-bd10fc2d-86e3-4f2b-bf9c-e4add9736876 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031003 May 25 07:40:15.242968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 232/478] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:40:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:40:15.292009 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-3a9b7fd8-1109-40d9-8d93-1083203281b6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:15.292726 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-3a9b7fd8-1109-40d9-8d93-1083203281b6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:15.299079 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3a9b7fd8-1109-40d9-8d93-1083203281b6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:15.299535 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3a9b7fd8-1109-40d9-8d93-1083203281b6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:15.300290 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3a9b7fd8-1109-40d9-8d93-1083203281b6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:15.300766 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3a9b7fd8-1109-40d9-8d93-1083203281b6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:15.396518 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-5cfe3a21-d166-43e5-8bfc-6183a7cc9b0f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "POST /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25/action" status: 202 len: 0 microversion: 2.1 time: 0.264470 May 25 07:40:15.400433 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 247/479] 10.222.0.24 () {60 vars in 1277 bytes} [Wed May 25 07:40:15 2022] POST /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25/action => generated 0 bytes in 269 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:40:15.406210 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-01f8e428-86ea-411e-b01c-0f5ca9643ac4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:15.406450 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-01f8e428-86ea-411e-b01c-0f5ca9643ac4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:15.421878 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-01f8e428-86ea-411e-b01c-0f5ca9643ac4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:15.422331 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-01f8e428-86ea-411e-b01c-0f5ca9643ac4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:15.424754 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-01f8e428-86ea-411e-b01c-0f5ca9643ac4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:15.424754 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-01f8e428-86ea-411e-b01c-0f5ca9643ac4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:15.450737 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-3a9b7fd8-1109-40d9-8d93-1083203281b6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:15.459126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-3a9b7fd8-1109-40d9-8d93-1083203281b6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1259 microversion: 2.1 time: 0.171824 May 25 07:40:15.468879 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 233/480] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:15 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1259 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:15.468879 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-83412de2-3ad1-49f1-a011-407b6d659151 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:15.468879 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-83412de2-3ad1-49f1-a011-407b6d659151 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:15.473624 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-83412de2-3ad1-49f1-a011-407b6d659151 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:15.474149 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-83412de2-3ad1-49f1-a011-407b6d659151 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:15.475045 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-83412de2-3ad1-49f1-a011-407b6d659151 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:15.476321 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-83412de2-3ad1-49f1-a011-407b6d659151 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:15.541558 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-83412de2-3ad1-49f1-a011-407b6d659151 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:15.552261 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-83412de2-3ad1-49f1-a011-407b6d659151 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 200 len: 1294 microversion: 2.1 time: 0.089501 May 25 07:40:15.552261 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 234/481] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:15 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 1294 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:15.661514 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-01f8e428-86ea-411e-b01c-0f5ca9643ac4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:15.665405 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:15.671964 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-01f8e428-86ea-411e-b01c-0f5ca9643ac4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1663 microversion: 2.1 time: 0.270266 May 25 07:40:15.672696 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 248/482] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:15 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1663 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:16.476614 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-62e2d7b3-402e-4ff8-819d-ea4e1cb84653 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:16.477332 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-62e2d7b3-402e-4ff8-819d-ea4e1cb84653 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:16.483830 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-62e2d7b3-402e-4ff8-819d-ea4e1cb84653 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:16.484281 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-62e2d7b3-402e-4ff8-819d-ea4e1cb84653 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:16.485339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-62e2d7b3-402e-4ff8-819d-ea4e1cb84653 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:16.485767 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-62e2d7b3-402e-4ff8-819d-ea4e1cb84653 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:16.571146 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a1323f75-8d54-46ee-a006-cb39b1d80ebe tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:16.575408 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a1323f75-8d54-46ee-a006-cb39b1d80ebe tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:16.585143 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a1323f75-8d54-46ee-a006-cb39b1d80ebe tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:16.588821 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a1323f75-8d54-46ee-a006-cb39b1d80ebe tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:16.589887 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a1323f75-8d54-46ee-a006-cb39b1d80ebe tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:16.590347 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a1323f75-8d54-46ee-a006-cb39b1d80ebe tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:16.668874 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a1323f75-8d54-46ee-a006-cb39b1d80ebe tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:16.677370 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a1323f75-8d54-46ee-a006-cb39b1d80ebe tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 200 len: 1300 microversion: 2.1 time: 0.111613 May 25 07:40:16.678731 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 249/483] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:16 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 1300 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:16.689725 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a10a0134-7531-4173-9a9a-83640f7213da tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:16.690697 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a10a0134-7531-4173-9a9a-83640f7213da tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:16.693682 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:16.700747 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a10a0134-7531-4173-9a9a-83640f7213da tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:16.701294 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a10a0134-7531-4173-9a9a-83640f7213da tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:16.702223 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a10a0134-7531-4173-9a9a-83640f7213da tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:16.702740 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a10a0134-7531-4173-9a9a-83640f7213da tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:16.726586 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-62e2d7b3-402e-4ff8-819d-ea4e1cb84653 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:16.734947 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-62e2d7b3-402e-4ff8-819d-ea4e1cb84653 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1259 microversion: 2.1 time: 0.262083 May 25 07:40:16.735531 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 235/484] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:16 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1259 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:16.840292 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a10a0134-7531-4173-9a9a-83640f7213da tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:16.847677 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a10a0134-7531-4173-9a9a-83640f7213da tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1663 microversion: 2.1 time: 0.162087 May 25 07:40:16.848236 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 250/485] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:16 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1663 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:17.697326 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c019df4b-231a-4146-a1b1-e6cdbf80100f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:17.697945 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c019df4b-231a-4146-a1b1-e6cdbf80100f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:17.704683 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c019df4b-231a-4146-a1b1-e6cdbf80100f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:17.705139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c019df4b-231a-4146-a1b1-e6cdbf80100f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:17.705919 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c019df4b-231a-4146-a1b1-e6cdbf80100f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:17.706358 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c019df4b-231a-4146-a1b1-e6cdbf80100f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:17.751502 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-641a39f1-024c-4bc5-8a37-ce800ef04a8c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:17.752156 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-641a39f1-024c-4bc5-8a37-ce800ef04a8c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:17.759902 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-641a39f1-024c-4bc5-8a37-ce800ef04a8c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:17.760359 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-641a39f1-024c-4bc5-8a37-ce800ef04a8c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:17.764981 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-641a39f1-024c-4bc5-8a37-ce800ef04a8c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:17.764981 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-641a39f1-024c-4bc5-8a37-ce800ef04a8c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:17.892992 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-641a39f1-024c-4bc5-8a37-ce800ef04a8c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:17.901375 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-641a39f1-024c-4bc5-8a37-ce800ef04a8c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1259 microversion: 2.1 time: 0.154056 May 25 07:40:17.901982 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 251/486] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:17 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1259 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:17.906837 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b64059ef-10bd-4891-8b76-5157192ea5ee tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:17.907714 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b64059ef-10bd-4891-8b76-5157192ea5ee tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:17.913792 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b64059ef-10bd-4891-8b76-5157192ea5ee tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:17.914256 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b64059ef-10bd-4891-8b76-5157192ea5ee tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:17.915038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b64059ef-10bd-4891-8b76-5157192ea5ee tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:17.915658 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b64059ef-10bd-4891-8b76-5157192ea5ee tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:17.948186 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c019df4b-231a-4146-a1b1-e6cdbf80100f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:17.956088 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c019df4b-231a-4146-a1b1-e6cdbf80100f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 200 len: 1367 microversion: 2.1 time: 0.262631 May 25 07:40:17.957009 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 236/487] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:17 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 1367 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:18.057278 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b64059ef-10bd-4891-8b76-5157192ea5ee tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:18.065496 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b64059ef-10bd-4891-8b76-5157192ea5ee tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1667 microversion: 2.1 time: 0.162341 May 25 07:40:18.066236 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 252/488] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:17 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1667 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:18.531118 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-c2796ae9-27d9-4049-bb01-3f2a4185ce1f req-1b1a8518-8c5f-4d50-a5b0-0ae8f9c29866 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b6c572-c0f9-46e4-bd01-0cc1583cfe58", "tag": "627e7547-a34e-487f-a611-64aa7bd85302"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:40:18.546235 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-c2796ae9-27d9-4049-bb01-3f2a4185ce1f req-1b1a8518-8c5f-4d50-a5b0-0ae8f9c29866 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:18.546917 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-c2796ae9-27d9-4049-bb01-3f2a4185ce1f req-1b1a8518-8c5f-4d50-a5b0-0ae8f9c29866 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:18.565219 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-c2796ae9-27d9-4049-bb01-3f2a4185ce1f req-1b1a8518-8c5f-4d50-a5b0-0ae8f9c29866 service nova] Creating event network-changed:627e7547-a34e-487f-a611-64aa7bd85302 for instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 on hv-cinder-82549 May 25 07:40:18.571287 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-c2796ae9-27d9-4049-bb01-3f2a4185ce1f req-1b1a8518-8c5f-4d50-a5b0-0ae8f9c29866 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044892 May 25 07:40:18.571982 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 237/489] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:40:18.817511 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-679c7061-ca3b-4d86-8ff6-05549634aef5 req-a7309dc4-283f-4ea8-a247-8dda2a1afb70 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63430b83-f298-430c-9ca9-bdd4d69bde91", "name": "network-vif-plugged", "status": "completed", "tag": "6d5abc91-52ce-441e-be4e-749082dec7ae"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:40:18.827978 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-679c7061-ca3b-4d86-8ff6-05549634aef5 req-a7309dc4-283f-4ea8-a247-8dda2a1afb70 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:18.827978 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-679c7061-ca3b-4d86-8ff6-05549634aef5 req-a7309dc4-283f-4ea8-a247-8dda2a1afb70 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:18.840347 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-679c7061-ca3b-4d86-8ff6-05549634aef5 req-a7309dc4-283f-4ea8-a247-8dda2a1afb70 service nova] Creating event network-vif-plugged:6d5abc91-52ce-441e-be4e-749082dec7ae for instance 63430b83-f298-430c-9ca9-bdd4d69bde91 on hv-cinder-82549 May 25 07:40:18.845787 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-679c7061-ca3b-4d86-8ff6-05549634aef5 req-a7309dc4-283f-4ea8-a247-8dda2a1afb70 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032125 May 25 07:40:18.846399 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 253/490] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:40:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:40:18.922041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1aced5d7-142c-4a01-8877-7ff664ba750a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:18.922738 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-1aced5d7-142c-4a01-8877-7ff664ba750a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:18.929998 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1aced5d7-142c-4a01-8877-7ff664ba750a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:18.931097 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1aced5d7-142c-4a01-8877-7ff664ba750a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:18.931943 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1aced5d7-142c-4a01-8877-7ff664ba750a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:18.932980 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1aced5d7-142c-4a01-8877-7ff664ba750a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:18.974143 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-d74a9766-c729-4c98-a773-789723d32c93 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:18.974929 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-d74a9766-c729-4c98-a773-789723d32c93 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:18.981690 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d74a9766-c729-4c98-a773-789723d32c93 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:18.982210 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d74a9766-c729-4c98-a773-789723d32c93 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:18.983183 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d74a9766-c729-4c98-a773-789723d32c93 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:18.983693 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d74a9766-c729-4c98-a773-789723d32c93 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:19.108578 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1aced5d7-142c-4a01-8877-7ff664ba750a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:19.117496 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-1aced5d7-142c-4a01-8877-7ff664ba750a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1259 microversion: 2.1 time: 0.200804 May 25 07:40:19.118278 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 238/491] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:18 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1259 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:19.126806 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d74a9766-c729-4c98-a773-789723d32c93 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:19.134538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-d74a9766-c729-4c98-a773-789723d32c93 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 200 len: 1367 microversion: 2.1 time: 0.164697 May 25 07:40:19.135249 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 254/492] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:18 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:20.134294 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d5241640-b282-4101-ba66-702b237a849f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:20.134904 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d5241640-b282-4101-ba66-702b237a849f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:20.142856 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d5241640-b282-4101-ba66-702b237a849f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:20.143297 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d5241640-b282-4101-ba66-702b237a849f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:20.144063 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d5241640-b282-4101-ba66-702b237a849f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:20.144879 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d5241640-b282-4101-ba66-702b237a849f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:20.153392 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a4e320f8-4d5e-49e7-9635-d052fa4615c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:20.154007 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a4e320f8-4d5e-49e7-9635-d052fa4615c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:20.160443 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a4e320f8-4d5e-49e7-9635-d052fa4615c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:20.160931 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a4e320f8-4d5e-49e7-9635-d052fa4615c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:20.161731 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a4e320f8-4d5e-49e7-9635-d052fa4615c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:20.162172 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a4e320f8-4d5e-49e7-9635-d052fa4615c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:20.280734 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d5241640-b282-4101-ba66-702b237a849f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:20.289453 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d5241640-b282-4101-ba66-702b237a849f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1259 microversion: 2.1 time: 0.158651 May 25 07:40:20.290124 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 239/493] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:20 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1259 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:20.291954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a4e320f8-4d5e-49e7-9635-d052fa4615c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:20.299710 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a4e320f8-4d5e-49e7-9635-d052fa4615c2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 200 len: 1367 microversion: 2.1 time: 0.150205 May 25 07:40:20.300275 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 255/494] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:20 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:21.306177 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-a9672395-46c3-4d46-9a99-5c6aa62756b6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:21.306929 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-a9672395-46c3-4d46-9a99-5c6aa62756b6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:21.313878 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a9672395-46c3-4d46-9a99-5c6aa62756b6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:21.314355 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a9672395-46c3-4d46-9a99-5c6aa62756b6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:21.315096 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a9672395-46c3-4d46-9a99-5c6aa62756b6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:21.315527 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a9672395-46c3-4d46-9a99-5c6aa62756b6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:21.317048 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a5d7528c-f37b-464d-9705-89efb496179a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:21.317762 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a5d7528c-f37b-464d-9705-89efb496179a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:21.325076 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a5d7528c-f37b-464d-9705-89efb496179a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:21.325608 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a5d7528c-f37b-464d-9705-89efb496179a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:21.326469 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a5d7528c-f37b-464d-9705-89efb496179a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:21.326977 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a5d7528c-f37b-464d-9705-89efb496179a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:21.450194 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a9672395-46c3-4d46-9a99-5c6aa62756b6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:21.458089 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-a9672395-46c3-4d46-9a99-5c6aa62756b6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1259 microversion: 2.1 time: 0.156069 May 25 07:40:21.458855 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 240/495] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:21 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1259 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:21.469539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a5d7528c-f37b-464d-9705-89efb496179a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:21.477672 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a5d7528c-f37b-464d-9705-89efb496179a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 200 len: 1367 microversion: 2.1 time: 0.165079 May 25 07:40:21.478234 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 256/496] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:21 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:22.474769 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-cf9576c2-ebfe-479a-96be-32519fd04a41 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:22.475975 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-cf9576c2-ebfe-479a-96be-32519fd04a41 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:22.478573 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:22.483553 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cf9576c2-ebfe-479a-96be-32519fd04a41 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:22.483991 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cf9576c2-ebfe-479a-96be-32519fd04a41 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:22.485068 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cf9576c2-ebfe-479a-96be-32519fd04a41 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:22.485501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cf9576c2-ebfe-479a-96be-32519fd04a41 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:22.494801 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a38b1edf-2d37-43b1-80cc-5c7aa7ccc453 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:22.495412 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a38b1edf-2d37-43b1-80cc-5c7aa7ccc453 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:22.501933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a38b1edf-2d37-43b1-80cc-5c7aa7ccc453 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:22.502383 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a38b1edf-2d37-43b1-80cc-5c7aa7ccc453 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:22.503141 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a38b1edf-2d37-43b1-80cc-5c7aa7ccc453 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:22.503574 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a38b1edf-2d37-43b1-80cc-5c7aa7ccc453 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:22.621567 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-cf9576c2-ebfe-479a-96be-32519fd04a41 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:22.629227 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-cf9576c2-ebfe-479a-96be-32519fd04a41 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1443 microversion: 2.1 time: 0.158275 May 25 07:40:22.629804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 241/497] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:22 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1443 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:22.638053 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a38b1edf-2d37-43b1-80cc-5c7aa7ccc453 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:22.645106 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-b4cbfdc8-fda1-4e00-9481-8c1ffe4dc7c7 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:22.657759 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a38b1edf-2d37-43b1-80cc-5c7aa7ccc453 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 200 len: 1367 microversion: 2.1 time: 0.154720 May 25 07:40:22.657887 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-b4cbfdc8-fda1-4e00-9481-8c1ffe4dc7c7 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:22.657985 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 257/498] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:22 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:22.658081 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b4cbfdc8-fda1-4e00-9481-8c1ffe4dc7c7 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:22.658081 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b4cbfdc8-fda1-4e00-9481-8c1ffe4dc7c7 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:22.658081 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b4cbfdc8-fda1-4e00-9481-8c1ffe4dc7c7 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:22.658081 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b4cbfdc8-fda1-4e00-9481-8c1ffe4dc7c7 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:22.783072 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-b4cbfdc8-fda1-4e00-9481-8c1ffe4dc7c7 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:22.790441 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-b4cbfdc8-fda1-4e00-9481-8c1ffe4dc7c7 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1443 microversion: 2.1 time: 0.149140 May 25 07:40:22.791012 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 242/499] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:22 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1443 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:23.666182 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-5e2fc322-1998-48d2-8c60-b7da9741dc98 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:23.666802 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-5e2fc322-1998-48d2-8c60-b7da9741dc98 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:23.668781 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=2 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:23.669541 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=6 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:23.674902 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5e2fc322-1998-48d2-8c60-b7da9741dc98 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:23.675617 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5e2fc322-1998-48d2-8c60-b7da9741dc98 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:23.676400 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5e2fc322-1998-48d2-8c60-b7da9741dc98 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:23.676876 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5e2fc322-1998-48d2-8c60-b7da9741dc98 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:23.812196 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-5e2fc322-1998-48d2-8c60-b7da9741dc98 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:23.820029 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-5e2fc322-1998-48d2-8c60-b7da9741dc98 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 200 len: 1367 microversion: 2.1 time: 0.158567 May 25 07:40:23.820627 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 258/500] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:23 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 1367 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:24.837427 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-a769c163-bc5c-4874-bc01-64280301612a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:24.838189 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-a769c163-bc5c-4874-bc01-64280301612a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:24.840196 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=16 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:24.845612 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a769c163-bc5c-4874-bc01-64280301612a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:24.846067 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a769c163-bc5c-4874-bc01-64280301612a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:24.846849 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a769c163-bc5c-4874-bc01-64280301612a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:24.847288 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a769c163-bc5c-4874-bc01-64280301612a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:25.033454 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a769c163-bc5c-4874-bc01-64280301612a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:25.041613 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-a769c163-bc5c-4874-bc01-64280301612a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 200 len: 1367 microversion: 2.1 time: 0.208312 May 25 07:40:25.050959 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 243/501] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:24 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 1367 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:25.238216 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-9778e9a6-dc02-48fe-9f13-a600b5352f95 req-67b173e4-37f8-4e9e-8e20-38d4e9e4f16c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63430b83-f298-430c-9ca9-bdd4d69bde91", "tag": "6d5abc91-52ce-441e-be4e-749082dec7ae"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:40:25.247538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-9778e9a6-dc02-48fe-9f13-a600b5352f95 req-67b173e4-37f8-4e9e-8e20-38d4e9e4f16c service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:25.248070 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-9778e9a6-dc02-48fe-9f13-a600b5352f95 req-67b173e4-37f8-4e9e-8e20-38d4e9e4f16c service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:25.258870 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-9778e9a6-dc02-48fe-9f13-a600b5352f95 req-67b173e4-37f8-4e9e-8e20-38d4e9e4f16c service nova] Creating event network-changed:6d5abc91-52ce-441e-be4e-749082dec7ae for instance 63430b83-f298-430c-9ca9-bdd4d69bde91 on hv-cinder-82549 May 25 07:40:25.263966 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-9778e9a6-dc02-48fe-9f13-a600b5352f95 req-67b173e4-37f8-4e9e-8e20-38d4e9e4f16c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029592 May 25 07:40:25.264820 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 259/502] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:40:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:40:26.058804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-9a758b60-06db-44c1-8859-6850cf31ccd9 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:26.059412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-9a758b60-06db-44c1-8859-6850cf31ccd9 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:26.065949 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9a758b60-06db-44c1-8859-6850cf31ccd9 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:26.066438 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9a758b60-06db-44c1-8859-6850cf31ccd9 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:26.067285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9a758b60-06db-44c1-8859-6850cf31ccd9 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:26.067756 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9a758b60-06db-44c1-8859-6850cf31ccd9 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:26.203209 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9a758b60-06db-44c1-8859-6850cf31ccd9 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:26.210954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-9a758b60-06db-44c1-8859-6850cf31ccd9 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 200 len: 1367 microversion: 2.1 time: 0.156019 May 25 07:40:26.211532 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 244/503] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:26 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 1367 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:26.662211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-fc9674f9-68c9-41bf-b5be-9e52fa6111a9 req-a8c56bfa-3294-4d90-b0e9-4dc18d68108c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b6c572-c0f9-46e4-bd01-0cc1583cfe58", "name": "network-vif-plugged", "status": "completed", "tag": "627e7547-a34e-487f-a611-64aa7bd85302"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:40:26.671180 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-fc9674f9-68c9-41bf-b5be-9e52fa6111a9 req-a8c56bfa-3294-4d90-b0e9-4dc18d68108c service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:26.671627 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-fc9674f9-68c9-41bf-b5be-9e52fa6111a9 req-a8c56bfa-3294-4d90-b0e9-4dc18d68108c service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:26.682861 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-fc9674f9-68c9-41bf-b5be-9e52fa6111a9 req-a8c56bfa-3294-4d90-b0e9-4dc18d68108c service nova] Creating event network-vif-plugged:627e7547-a34e-487f-a611-64aa7bd85302 for instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 on hv-cinder-82549 May 25 07:40:26.687760 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-fc9674f9-68c9-41bf-b5be-9e52fa6111a9 req-a8c56bfa-3294-4d90-b0e9-4dc18d68108c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030115 May 25 07:40:26.688428 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 260/504] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:40:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:40:27.227498 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-b556e2c0-d90f-4a4d-94c8-0692c309798c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:27.228117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-b556e2c0-d90f-4a4d-94c8-0692c309798c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:27.235242 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b556e2c0-d90f-4a4d-94c8-0692c309798c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:27.235696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b556e2c0-d90f-4a4d-94c8-0692c309798c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:27.236465 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b556e2c0-d90f-4a4d-94c8-0692c309798c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:27.236956 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b556e2c0-d90f-4a4d-94c8-0692c309798c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:27.365682 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-b556e2c0-d90f-4a4d-94c8-0692c309798c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:27.373196 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-b556e2c0-d90f-4a4d-94c8-0692c309798c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 200 len: 1367 microversion: 2.1 time: 0.149652 May 25 07:40:27.373764 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 245/505] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:27 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:28.391556 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-923bd983-26d5-4761-9266-9807d6967f51 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:28.392214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-923bd983-26d5-4761-9266-9807d6967f51 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:28.399111 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-923bd983-26d5-4761-9266-9807d6967f51 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:28.399568 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-923bd983-26d5-4761-9266-9807d6967f51 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:28.400344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-923bd983-26d5-4761-9266-9807d6967f51 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:28.400820 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-923bd983-26d5-4761-9266-9807d6967f51 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:28.533159 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-923bd983-26d5-4761-9266-9807d6967f51 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:28.541763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-923bd983-26d5-4761-9266-9807d6967f51 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 200 len: 1367 microversion: 2.1 time: 0.154969 May 25 07:40:28.542372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 261/506] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:28 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:29.559376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7bfd1ef1-6335-449c-8ac1-8ed9e69e5640 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:29.559997 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-7bfd1ef1-6335-449c-8ac1-8ed9e69e5640 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:29.566304 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7bfd1ef1-6335-449c-8ac1-8ed9e69e5640 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:29.566758 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7bfd1ef1-6335-449c-8ac1-8ed9e69e5640 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:29.567557 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7bfd1ef1-6335-449c-8ac1-8ed9e69e5640 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:29.568002 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7bfd1ef1-6335-449c-8ac1-8ed9e69e5640 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:29.697561 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7bfd1ef1-6335-449c-8ac1-8ed9e69e5640 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:29.705405 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-7bfd1ef1-6335-449c-8ac1-8ed9e69e5640 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 200 len: 1557 microversion: 2.1 time: 0.149945 May 25 07:40:29.705968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 246/507] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:29 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 1557 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:29.722004 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4a69a8be-feac-48af-80fe-95b1ac2dd8d4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:29.722531 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4a69a8be-feac-48af-80fe-95b1ac2dd8d4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:29.729469 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4a69a8be-feac-48af-80fe-95b1ac2dd8d4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:29.729914 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4a69a8be-feac-48af-80fe-95b1ac2dd8d4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:29.730680 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4a69a8be-feac-48af-80fe-95b1ac2dd8d4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:29.731115 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4a69a8be-feac-48af-80fe-95b1ac2dd8d4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:29.807155 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4a69a8be-feac-48af-80fe-95b1ac2dd8d4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.088975 May 25 07:40:29.807762 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 262/508] 10.222.0.24 () {58 vars in 1274 bytes} [Wed May 25 07:40:29 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:40:30.781630 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-25918082-001a-4a6c-8ac8-9872d68a02bd req-8d61daf6-4eab-4c37-a11f-cef8b059af92 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "43b6c572-c0f9-46e4-bd01-0cc1583cfe58", "tag": "627e7547-a34e-487f-a611-64aa7bd85302"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:40:30.790261 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-25918082-001a-4a6c-8ac8-9872d68a02bd req-8d61daf6-4eab-4c37-a11f-cef8b059af92 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:30.790706 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-25918082-001a-4a6c-8ac8-9872d68a02bd req-8d61daf6-4eab-4c37-a11f-cef8b059af92 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:30.801616 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-25918082-001a-4a6c-8ac8-9872d68a02bd req-8d61daf6-4eab-4c37-a11f-cef8b059af92 service nova] Creating event network-changed:627e7547-a34e-487f-a611-64aa7bd85302 for instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 on hv-cinder-82549 May 25 07:40:30.807200 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-25918082-001a-4a6c-8ac8-9872d68a02bd req-8d61daf6-4eab-4c37-a11f-cef8b059af92 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029250 May 25 07:40:30.808152 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 247/509] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:40:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:40:32.467465 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-f669b21e-945b-4eb4-b9f0-066c4373f938 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:32.467983 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-f669b21e-945b-4eb4-b9f0-066c4373f938 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:32.473955 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f669b21e-945b-4eb4-b9f0-066c4373f938 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:32.474406 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f669b21e-945b-4eb4-b9f0-066c4373f938 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:32.475686 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f669b21e-945b-4eb4-b9f0-066c4373f938 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:32.476131 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f669b21e-945b-4eb4-b9f0-066c4373f938 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:32.506075 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-f669b21e-945b-4eb4-b9f0-066c4373f938 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd/os-volume_attachments/6def8d01-32a2-48ac-a658-08ff6b93491c" status: 200 len: 194 microversion: 2.20 time: 0.043369 May 25 07:40:32.506770 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 263/510] 10.222.0.24 () {60 vars in 1453 bytes} [Wed May 25 07:40:32 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd/os-volume_attachments/6def8d01-32a2-48ac-a658-08ff6b93491c => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 07:40:32.578138 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7d9c4cd6-0114-452d-a86a-e201ae43c581 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:32.578504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-7d9c4cd6-0114-452d-a86a-e201ae43c581 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:32.585525 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7d9c4cd6-0114-452d-a86a-e201ae43c581 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:32.586033 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7d9c4cd6-0114-452d-a86a-e201ae43c581 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:32.586822 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7d9c4cd6-0114-452d-a86a-e201ae43c581 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:32.587298 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7d9c4cd6-0114-452d-a86a-e201ae43c581 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:32.673180 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.objects.instance [None req-7d9c4cd6-0114-452d-a86a-e201ae43c581 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lazy-loading 'services' on Instance uuid 6d360341-449d-4b49-8b66-a02a969171fd {{(pid=124674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:40:32.878756 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=100 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:32.969439 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-7d9c4cd6-0114-452d-a86a-e201ae43c581 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "DELETE /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd/os-volume_attachments/6def8d01-32a2-48ac-a658-08ff6b93491c" status: 202 len: 0 microversion: 2.20 time: 0.396457 May 25 07:40:32.970027 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 248/511] 10.222.0.24 () {60 vars in 1456 bytes} [Wed May 25 07:40:32 2022] DELETE /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd/os-volume_attachments/6def8d01-32a2-48ac-a658-08ff6b93491c => generated 0 bytes in 398 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 07:40:32.979341 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-1fe73cc8-4ca7-41f8-a295-ea4e2a9edb9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:32.980331 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-1fe73cc8-4ca7-41f8-a295-ea4e2a9edb9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:32.986835 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1fe73cc8-4ca7-41f8-a295-ea4e2a9edb9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:32.987286 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1fe73cc8-4ca7-41f8-a295-ea4e2a9edb9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:32.988034 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1fe73cc8-4ca7-41f8-a295-ea4e2a9edb9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:32.988525 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1fe73cc8-4ca7-41f8-a295-ea4e2a9edb9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:33.016466 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-1fe73cc8-4ca7-41f8-a295-ea4e2a9edb9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.041921 May 25 07:40:33.017024 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 264/512] 10.222.0.24 () {60 vars in 1342 bytes} [Wed May 25 07:40:32 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 07:40:34.029581 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-2c493ce0-2821-4fdf-bd32-1e5d266e4aaf tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:34.030638 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-2c493ce0-2821-4fdf-bd32-1e5d266e4aaf tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:34.036899 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2c493ce0-2821-4fdf-bd32-1e5d266e4aaf tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:34.037353 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2c493ce0-2821-4fdf-bd32-1e5d266e4aaf tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:34.038729 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2c493ce0-2821-4fdf-bd32-1e5d266e4aaf tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:34.039165 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2c493ce0-2821-4fdf-bd32-1e5d266e4aaf tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:34.068893 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-2c493ce0-2821-4fdf-bd32-1e5d266e4aaf tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044332 May 25 07:40:34.069722 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 249/513] 10.222.0.24 () {60 vars in 1342 bytes} [Wed May 25 07:40:34 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 07:40:35.081032 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-e00e52a1-60ab-48de-bc31-bb9e904e874e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:35.082007 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-e00e52a1-60ab-48de-bc31-bb9e904e874e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:35.089426 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e00e52a1-60ab-48de-bc31-bb9e904e874e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:35.094210 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e00e52a1-60ab-48de-bc31-bb9e904e874e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:35.094210 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e00e52a1-60ab-48de-bc31-bb9e904e874e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:35.094210 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e00e52a1-60ab-48de-bc31-bb9e904e874e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:35.119671 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-e00e52a1-60ab-48de-bc31-bb9e904e874e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042681 May 25 07:40:35.120239 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 265/514] 10.222.0.24 () {60 vars in 1342 bytes} [Wed May 25 07:40:35 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:35.182048 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-0796d45e-7f12-444c-877c-994a30fa4757 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:35.182591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-0796d45e-7f12-444c-877c-994a30fa4757 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:35.189010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0796d45e-7f12-444c-877c-994a30fa4757 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:35.189446 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0796d45e-7f12-444c-877c-994a30fa4757 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:35.190203 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0796d45e-7f12-444c-877c-994a30fa4757 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:35.190631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0796d45e-7f12-444c-877c-994a30fa4757 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:35.215814 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-0796d45e-7f12-444c-877c-994a30fa4757 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Going to try to terminate instance {{(pid=124674) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:40:35.561004 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-0796d45e-7f12-444c-877c-994a30fa4757 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "DELETE /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 204 len: 0 microversion: 2.20 time: 0.383266 May 25 07:40:35.561601 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 250/515] 10.222.0.24 () {60 vars in 1279 bytes} [Wed May 25 07:40:35 2022] DELETE /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 0 bytes in 385 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 25 07:40:35.569909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-f6b197ac-10bc-4408-a658-7d35b1b15398 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:35.570809 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-f6b197ac-10bc-4408-a658-7d35b1b15398 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:35.577040 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f6b197ac-10bc-4408-a658-7d35b1b15398 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:35.577492 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f6b197ac-10bc-4408-a658-7d35b1b15398 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:35.578263 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f6b197ac-10bc-4408-a658-7d35b1b15398 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:35.582407 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f6b197ac-10bc-4408-a658-7d35b1b15398 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:35.705968 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-f6b197ac-10bc-4408-a658-7d35b1b15398 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:35.714134 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-f6b197ac-10bc-4408-a658-7d35b1b15398 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:35.715664 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-f6b197ac-10bc-4408-a658-7d35b1b15398 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:35.716864 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-f6b197ac-10bc-4408-a658-7d35b1b15398 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.150992 May 25 07:40:35.717416 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 266/516] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:40:35 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:40:36.736810 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1b089495-2838-4429-b03e-b33108e279d0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:36.737531 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-1b089495-2838-4429-b03e-b33108e279d0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:36.744989 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1b089495-2838-4429-b03e-b33108e279d0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:36.745433 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1b089495-2838-4429-b03e-b33108e279d0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:36.746224 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1b089495-2838-4429-b03e-b33108e279d0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:36.746654 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1b089495-2838-4429-b03e-b33108e279d0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:36.884446 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1b089495-2838-4429-b03e-b33108e279d0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:36.892727 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1b089495-2838-4429-b03e-b33108e279d0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:36.894261 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1b089495-2838-4429-b03e-b33108e279d0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:36.895432 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-1b089495-2838-4429-b03e-b33108e279d0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.163260 May 25 07:40:36.896019 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 251/517] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:40:36 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:40:37.914579 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b9f5bcde-c393-4743-bc1a-4cb298540b01 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:37.915205 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b9f5bcde-c393-4743-bc1a-4cb298540b01 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:37.922032 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b9f5bcde-c393-4743-bc1a-4cb298540b01 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:37.922481 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b9f5bcde-c393-4743-bc1a-4cb298540b01 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:37.923251 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b9f5bcde-c393-4743-bc1a-4cb298540b01 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:37.923687 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b9f5bcde-c393-4743-bc1a-4cb298540b01 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:38.057174 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b9f5bcde-c393-4743-bc1a-4cb298540b01 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:38.059879 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=100 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:38.066834 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b9f5bcde-c393-4743-bc1a-4cb298540b01 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:38.068441 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b9f5bcde-c393-4743-bc1a-4cb298540b01 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:38.070081 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b9f5bcde-c393-4743-bc1a-4cb298540b01 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1722 microversion: 2.20 time: 0.159519 May 25 07:40:38.072511 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 267/518] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:40:37 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1722 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:40:38.799306 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-25e28820-cafd-4985-9bc7-0d9c89723b23 req-3103d88a-d8e5-4a3c-a97d-488b0dbd071f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6d360341-449d-4b49-8b66-a02a969171fd", "name": "network-vif-deleted", "tag": "5b9220dd-eeaa-4ea1-a0cd-e54c1dbfe455"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:40:38.809638 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-25e28820-cafd-4985-9bc7-0d9c89723b23 req-3103d88a-d8e5-4a3c-a97d-488b0dbd071f service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:38.810529 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-25e28820-cafd-4985-9bc7-0d9c89723b23 req-3103d88a-d8e5-4a3c-a97d-488b0dbd071f service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:38.823462 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-25e28820-cafd-4985-9bc7-0d9c89723b23 req-3103d88a-d8e5-4a3c-a97d-488b0dbd071f service nova] Creating event network-vif-deleted:5b9220dd-eeaa-4ea1-a0cd-e54c1dbfe455 for instance 6d360341-449d-4b49-8b66-a02a969171fd on hv-cinder-82549 May 25 07:40:38.828549 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-25e28820-cafd-4985-9bc7-0d9c89723b23 req-3103d88a-d8e5-4a3c-a97d-488b0dbd071f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034706 May 25 07:40:38.829136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 252/519] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:40:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:40:39.088528 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4dc14fe7-74a0-4d11-9fe9-0991922ca92c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:39.089250 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4dc14fe7-74a0-4d11-9fe9-0991922ca92c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:39.096305 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4dc14fe7-74a0-4d11-9fe9-0991922ca92c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:39.096857 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4dc14fe7-74a0-4d11-9fe9-0991922ca92c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:39.097698 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4dc14fe7-74a0-4d11-9fe9-0991922ca92c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:39.098208 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4dc14fe7-74a0-4d11-9fe9-0991922ca92c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:39.161694 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4dc14fe7-74a0-4d11-9fe9-0991922ca92c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:39.170001 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4dc14fe7-74a0-4d11-9fe9-0991922ca92c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:39.171563 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4dc14fe7-74a0-4d11-9fe9-0991922ca92c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:39.172776 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4dc14fe7-74a0-4d11-9fe9-0991922ca92c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 200 len: 1366 microversion: 2.20 time: 0.088126 May 25 07:40:39.173359 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 268/520] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:40:39 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 1366 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:40:40.192344 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-b5132db3-86e1-4f29-a255-86487b2ce9e0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:40.193156 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-b5132db3-86e1-4f29-a255-86487b2ce9e0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:40.199891 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b5132db3-86e1-4f29-a255-86487b2ce9e0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:40.200351 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b5132db3-86e1-4f29-a255-86487b2ce9e0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:40.201149 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b5132db3-86e1-4f29-a255-86487b2ce9e0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:40.201589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b5132db3-86e1-4f29-a255-86487b2ce9e0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:40.215307 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-b5132db3-86e1-4f29-a255-86487b2ce9e0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] HTTP exception thrown: Instance 6d360341-449d-4b49-8b66-a02a969171fd could not be found. May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-b5132db3-86e1-4f29-a255-86487b2ce9e0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Request method failure captured: May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd HTTP/1.1 May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdyOBUPtSBv_eZ9cAz2wmqxZFgS0h6lu4oleBQhTwW57V0_ZEgIfF3Fa2nqQqpNtw6SNQ7TwNzOQPNz_TQi8qcT7_jV9J5Zk70rltDxuLkh_nBHTh2GRmxu7bokZP8XuH91WxV-Vdd3o5QvH60Jx6GJag75pCbi-MFMAELCN19x7CDo May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Openstack-Nova-Api-Version: 2.20 May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: c4406d5d0e2347f1b96c34496f5ba5ae May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-605607613 May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:40:40.216984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:40:40.218675 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4406d5d0e2347f1b96c34496f5ba5ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c4406d5d0e2347f1b96c34496f5ba5ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c4406d5d0e2347f1b96c34496f5ba5ae", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4406d5d0e2347f1b96c34496f5ba5ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:40:40.218675 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-AttachVolumeShelveTestJSON-605607613 May 25 07:40:40.218675 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: c4406d5d0e2347f1b96c34496f5ba5ae May 25 07:40:40.218675 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-605607613 May 25 07:40:40.218675 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-AttachVolumeShelveTestJSON-605607613-project May 25 07:40:40.218675 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:40:40.218675 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:40:40.218675 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: 18eb8b615526451498d3adc382d5a410 May 25 07:40:40.218675 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-AttachVolumeShelveTestJSON-605607613-project May 25 07:40:40.218675 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:40:40.218675 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Instance 6d360341-449d-4b49-8b66-a02a969171fd could not be found. May 25 07:40:40.218675 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': '6d360341-449d-4b49-8b66-a02a969171fd'} May 25 07:40:40.219674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:40:40.219674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:40:40.219674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:40:40.219674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:40:40.219674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:40:40.219674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:40:40.219674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:40:40.219674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:40:40.219674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:40:40.219674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:40:40.219674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d360341-449d-4b49-8b66-a02a969171fd could not be found. May 25 07:40:40.219674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:40:40.219674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:40:40.219674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:40:40.219674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:40:40.219674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:40:40.219674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:40:40.219674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:40:40.219674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:40:40.219674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:40:40.221318 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:40:40.221318 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:40:40.221318 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:40:40.221318 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:40:40.221318 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:40:40.221318 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:40:40.221318 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:40:40.221318 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d360341-449d-4b49-8b66-a02a969171fd could not be found. May 25 07:40:40.221318 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:40:40.221318 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:40:40.221318 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:40:40.221318 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:40:40.221318 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:40:40.221318 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:40:40.221318 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:40:40.221318 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:40:40.221318 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d360341-449d-4b49-8b66-a02a969171fd could not be found. May 25 07:40:40.221318 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:40:40.222618 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-b5132db3-86e1-4f29-a255-86487b2ce9e0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Returning 404 to user: Instance 6d360341-449d-4b49-8b66-a02a969171fd could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:40:40.222618 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-b5132db3-86e1-4f29-a255-86487b2ce9e0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 404 len: 111 microversion: 2.20 time: 0.030900 May 25 07:40:40.222618 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 253/521] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:40:40 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 07:40:40.227766 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4e7a6e13-1d84-409e-b944-0cc3af071b46 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '.version_select at 0x7fc864361ca0>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:40.316613 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4e7a6e13-1d84-409e-b944-0cc3af071b46 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1139576538" status: 204 len: 0 microversion: 2.20 time: 0.092853 May 25 07:40:40.317216 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 269/522] 10.222.0.24 () {60 vars in 1261 bytes} [Wed May 25 07:40:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1139576538 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 25 07:40:41.127733 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-21cd1985-a963-4176-ab85-83706530a277 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Action: 'create', calling method: .version_select at 0x7fc864293b80>, body: {"keypair": {"name": "tempest-keypair-1542565806", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBF2GnDEPBmOWsm4ReSrOfmQYxfXUcMNdC/JLCIkWxDuYyweLIKetr92MK0W9U2USdl/7Yf8T/IZD9OHev8lOjmakwGdmHvCyLtwz+bkJY7enT0qabIjxr7Ebl3/v3ruISQ=="}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:40:41.142295 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-21cd1985-a963-4176-ab85-83706530a277 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Getting quotas for project c4406d5d0e2347f1b96c34496f5ba5ae. Resources: {'key_pairs'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:40:41.146085 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-21cd1985-a963-4176-ab85-83706530a277 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Getting quotas for user 18eb8b615526451498d3adc382d5a410 and project c4406d5d0e2347f1b96c34496f5ba5ae. Resources: {'key_pairs'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:40:41.276679 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-21cd1985-a963-4176-ab85-83706530a277 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.152990 May 25 07:40:41.277398 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 254/523] 10.222.0.24 () {62 vars in 1199 bytes} [Wed May 25 07:40:41 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 154 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) May 25 07:40:43.763785 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-d0c1a8af-d450-4e54-9695-1d2ed2fc52c9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-893119252", "imageRef": "ddc5b622-a846-425a-b8fd-7e5caef00bf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "7eef0ae9-55de-48c4-ada3-da713e1942b9"}], "security_groups": [{"name": "tempest-securitygroup--1753044825"}], "key_name": "tempest-keypair-1542565806", "user_data": "}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:40:43.873214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.network.neutron [None req-d0c1a8af-d450-4e54-9695-1d2ed2fc52c9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] validate_networks() for [('7eef0ae9-55de-48c4-ada3-da713e1942b9', None, None, None, None, None)] {{(pid=124675) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:40:44.241344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-d0c1a8af-d450-4e54-9695-1d2ed2fc52c9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Flavor limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:40:44.241848 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-d0c1a8af-d450-4e54-9695-1d2ed2fc52c9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Image limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:40:44.242327 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-d0c1a8af-d450-4e54-9695-1d2ed2fc52c9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Flavor pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:40:44.242738 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-d0c1a8af-d450-4e54-9695-1d2ed2fc52c9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Image pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:40:44.243149 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-d0c1a8af-d450-4e54-9695-1d2ed2fc52c9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:40:44.251878 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d0c1a8af-d450-4e54-9695-1d2ed2fc52c9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:44.252323 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d0c1a8af-d450-4e54-9695-1d2ed2fc52c9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:44.253188 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d0c1a8af-d450-4e54-9695-1d2ed2fc52c9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:44.253621 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d0c1a8af-d450-4e54-9695-1d2ed2fc52c9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:44.270537 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-d0c1a8af-d450-4e54-9695-1d2ed2fc52c9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Getting quotas for project c4406d5d0e2347f1b96c34496f5ba5ae. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:40:44.275640 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-d0c1a8af-d450-4e54-9695-1d2ed2fc52c9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Getting quotas for user 18eb8b615526451498d3adc382d5a410 and project c4406d5d0e2347f1b96c34496f5ba5ae. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:40:44.286628 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-d0c1a8af-d450-4e54-9695-1d2ed2fc52c9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Going to run 1 instances... {{(pid=124675) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:40:44.289521 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-d0c1a8af-d450-4e54-9695-1d2ed2fc52c9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddc5b622-a846-425a-b8fd-7e5caef00bf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:40:44.500659 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-d0c1a8af-d450-4e54-9695-1d2ed2fc52c9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.741650 May 25 07:40:44.501236 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 270/524] 10.222.0.24 () {62 vars in 1187 bytes} [Wed May 25 07:40:43 2022] POST /compute/v2.1/servers => generated 402 bytes in 743 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) May 25 07:40:44.511918 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-b9099430-e8ef-419a-940b-ebbcf9193eab tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:44.512705 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-b9099430-e8ef-419a-940b-ebbcf9193eab tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:44.571698 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-b9099430-e8ef-419a-940b-ebbcf9193eab tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:44.581362 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-b9099430-e8ef-419a-940b-ebbcf9193eab tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:44.584421 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-b9099430-e8ef-419a-940b-ebbcf9193eab tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:44.588055 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-b9099430-e8ef-419a-940b-ebbcf9193eab tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1281 microversion: 2.20 time: 0.079614 May 25 07:40:44.589166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 255/525] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:40:44 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1281 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:40:45.607769 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b2769607-eb81-4906-afae-40418dd82b9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:45.608381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b2769607-eb81-4906-afae-40418dd82b9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:45.667568 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b2769607-eb81-4906-afae-40418dd82b9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:45.676293 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b2769607-eb81-4906-afae-40418dd82b9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:45.677860 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b2769607-eb81-4906-afae-40418dd82b9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:45.678976 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b2769607-eb81-4906-afae-40418dd82b9e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1281 microversion: 2.20 time: 0.076600 May 25 07:40:45.680081 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 271/526] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:40:45 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1281 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:40:46.697494 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-07569859-ac14-45f2-be02-56f42fb53b18 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:46.701134 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-07569859-ac14-45f2-be02-56f42fb53b18 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:46.705520 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-07569859-ac14-45f2-be02-56f42fb53b18 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:46.705976 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-07569859-ac14-45f2-be02-56f42fb53b18 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:46.706756 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-07569859-ac14-45f2-be02-56f42fb53b18 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:46.707198 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-07569859-ac14-45f2-be02-56f42fb53b18 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:46.769383 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-07569859-ac14-45f2-be02-56f42fb53b18 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:46.777984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-07569859-ac14-45f2-be02-56f42fb53b18 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:46.780408 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-07569859-ac14-45f2-be02-56f42fb53b18 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:46.782043 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-07569859-ac14-45f2-be02-56f42fb53b18 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1333 microversion: 2.20 time: 0.089079 May 25 07:40:46.782412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 256/527] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:40:46 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1333 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:40:47.799524 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-440a4184-0d42-45f2-b002-873e5b817aaa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:47.800320 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-440a4184-0d42-45f2-b002-873e5b817aaa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:47.807212 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-440a4184-0d42-45f2-b002-873e5b817aaa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:47.808179 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-440a4184-0d42-45f2-b002-873e5b817aaa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:47.811821 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-440a4184-0d42-45f2-b002-873e5b817aaa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:47.811821 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-440a4184-0d42-45f2-b002-873e5b817aaa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:47.873804 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-440a4184-0d42-45f2-b002-873e5b817aaa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:47.882281 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-440a4184-0d42-45f2-b002-873e5b817aaa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:47.883938 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-440a4184-0d42-45f2-b002-873e5b817aaa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:47.886475 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-440a4184-0d42-45f2-b002-873e5b817aaa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1339 microversion: 2.20 time: 0.089592 May 25 07:40:47.886475 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 272/528] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:40:47 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1339 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:40:48.903156 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1c0e33a2-3d29-4862-8037-9b3a12d18bfa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:48.903771 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-1c0e33a2-3d29-4862-8037-9b3a12d18bfa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:48.910614 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1c0e33a2-3d29-4862-8037-9b3a12d18bfa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:48.911062 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1c0e33a2-3d29-4862-8037-9b3a12d18bfa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:48.911831 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1c0e33a2-3d29-4862-8037-9b3a12d18bfa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:48.912269 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1c0e33a2-3d29-4862-8037-9b3a12d18bfa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:49.070443 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-10a4af7f-00f2-449e-8090-d4bfa15e25bc req-2d5f5b16-ecdd-4d35-a9c8-e25788d8d001 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ecec15-f302-4eea-92e6-37049703fa41", "tag": "28f4b108-96e9-447b-88dd-ed92dc19d98c"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:40:49.078046 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=62,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:49.083517 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-10a4af7f-00f2-449e-8090-d4bfa15e25bc req-2d5f5b16-ecdd-4d35-a9c8-e25788d8d001 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:49.083957 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-10a4af7f-00f2-449e-8090-d4bfa15e25bc req-2d5f5b16-ecdd-4d35-a9c8-e25788d8d001 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:49.096378 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-10a4af7f-00f2-449e-8090-d4bfa15e25bc req-2d5f5b16-ecdd-4d35-a9c8-e25788d8d001 service nova] Creating event network-changed:28f4b108-96e9-447b-88dd-ed92dc19d98c for instance c0ecec15-f302-4eea-92e6-37049703fa41 on hv-cinder-82549 May 25 07:40:49.103898 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-10a4af7f-00f2-449e-8090-d4bfa15e25bc req-2d5f5b16-ecdd-4d35-a9c8-e25788d8d001 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042392 May 25 07:40:49.106088 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 273/529] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:40:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:40:49.122976 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1c0e33a2-3d29-4862-8037-9b3a12d18bfa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:49.131536 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1c0e33a2-3d29-4862-8037-9b3a12d18bfa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:49.134003 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1c0e33a2-3d29-4862-8037-9b3a12d18bfa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:49.135103 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-1c0e33a2-3d29-4862-8037-9b3a12d18bfa tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1407 microversion: 2.20 time: 0.235840 May 25 07:40:49.135671 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 257/530] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:40:48 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1407 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:40:50.154598 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-6e073551-2f27-4b79-b159-5a02cf5a5060 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:50.155295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-6e073551-2f27-4b79-b159-5a02cf5a5060 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:50.162491 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6e073551-2f27-4b79-b159-5a02cf5a5060 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:50.162938 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6e073551-2f27-4b79-b159-5a02cf5a5060 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:50.164421 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6e073551-2f27-4b79-b159-5a02cf5a5060 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:50.164889 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6e073551-2f27-4b79-b159-5a02cf5a5060 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:50.295581 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-6e073551-2f27-4b79-b159-5a02cf5a5060 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:50.303464 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-6e073551-2f27-4b79-b159-5a02cf5a5060 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:50.306125 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-6e073551-2f27-4b79-b159-5a02cf5a5060 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:50.307691 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-6e073551-2f27-4b79-b159-5a02cf5a5060 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1407 microversion: 2.20 time: 0.157220 May 25 07:40:50.308522 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 274/531] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:40:50 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:40:51.091046 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-4a7f1ffe-ba08-472c-bde9-29a3f9dd9a62 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:51.091570 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-4a7f1ffe-ba08-472c-bde9-29a3f9dd9a62 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:51.098176 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4a7f1ffe-ba08-472c-bde9-29a3f9dd9a62 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:51.098573 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4a7f1ffe-ba08-472c-bde9-29a3f9dd9a62 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:51.099370 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4a7f1ffe-ba08-472c-bde9-29a3f9dd9a62 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:51.099777 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4a7f1ffe-ba08-472c-bde9-29a3f9dd9a62 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:51.181701 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.objects.instance [None req-4a7f1ffe-ba08-472c-bde9-29a3f9dd9a62 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lazy-loading 'services' on Instance uuid a5ef563c-52c0-40b3-bdf3-dc51e5422196 {{(pid=124674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:40:51.326448 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-d5ed76dc-d714-43f9-bfe9-e7a0fc3bf237 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:51.326971 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-d5ed76dc-d714-43f9-bfe9-e7a0fc3bf237 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:51.333785 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d5ed76dc-d714-43f9-bfe9-e7a0fc3bf237 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:51.334234 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d5ed76dc-d714-43f9-bfe9-e7a0fc3bf237 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:51.334998 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d5ed76dc-d714-43f9-bfe9-e7a0fc3bf237 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:51.335435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d5ed76dc-d714-43f9-bfe9-e7a0fc3bf237 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:51.437791 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-4a7f1ffe-ba08-472c-bde9-29a3f9dd9a62 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196/os-volume_attachments/fc32bf61-1ed8-421a-8a0d-533a1c6a23d5" status: 202 len: 0 microversion: 2.1 time: 0.350482 May 25 07:40:51.442287 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 258/532] 10.222.0.24 () {58 vars in 1415 bytes} [Wed May 25 07:40:51 2022] DELETE /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196/os-volume_attachments/fc32bf61-1ed8-421a-8a0d-533a1c6a23d5 => generated 0 bytes in 352 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:40:51.449111 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-ac5aa265-cfa5-4cf1-b4de-5b31bad0203e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:51.451070 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-ac5aa265-cfa5-4cf1-b4de-5b31bad0203e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:51.457188 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ac5aa265-cfa5-4cf1-b4de-5b31bad0203e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:51.457732 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ac5aa265-cfa5-4cf1-b4de-5b31bad0203e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:51.458518 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ac5aa265-cfa5-4cf1-b4de-5b31bad0203e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:51.458957 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ac5aa265-cfa5-4cf1-b4de-5b31bad0203e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:51.472898 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d5ed76dc-d714-43f9-bfe9-e7a0fc3bf237 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:51.481401 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d5ed76dc-d714-43f9-bfe9-e7a0fc3bf237 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:51.483029 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d5ed76dc-d714-43f9-bfe9-e7a0fc3bf237 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:51.484517 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-d5ed76dc-d714-43f9-bfe9-e7a0fc3bf237 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1407 microversion: 2.20 time: 0.161771 May 25 07:40:51.485077 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 275/533] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:40:51 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1407 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:40:51.496176 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-ac5aa265-cfa5-4cf1-b4de-5b31bad0203e tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.052578 May 25 07:40:51.496764 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 259/534] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:40:51 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:40:52.504152 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a18bcce8-0316-4731-9f45-747dc85cec8a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:52.504910 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a18bcce8-0316-4731-9f45-747dc85cec8a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:52.507973 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-bc9e9be9-d851-4337-9689-f9ad0492cc79 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:52.509002 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-bc9e9be9-d851-4337-9689-f9ad0492cc79 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:52.512333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a18bcce8-0316-4731-9f45-747dc85cec8a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:52.512818 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a18bcce8-0316-4731-9f45-747dc85cec8a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:52.513629 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a18bcce8-0316-4731-9f45-747dc85cec8a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:52.514032 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a18bcce8-0316-4731-9f45-747dc85cec8a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:52.515394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bc9e9be9-d851-4337-9689-f9ad0492cc79 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:52.515841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bc9e9be9-d851-4337-9689-f9ad0492cc79 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:52.516633 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bc9e9be9-d851-4337-9689-f9ad0492cc79 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:52.517062 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bc9e9be9-d851-4337-9689-f9ad0492cc79 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:52.547103 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-bc9e9be9-d851-4337-9689-f9ad0492cc79 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043483 May 25 07:40:52.551093 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 260/535] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:40:52 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:40:52.655733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a18bcce8-0316-4731-9f45-747dc85cec8a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:52.666352 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a18bcce8-0316-4731-9f45-747dc85cec8a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:52.667989 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a18bcce8-0316-4731-9f45-747dc85cec8a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:52.669159 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a18bcce8-0316-4731-9f45-747dc85cec8a tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1407 microversion: 2.20 time: 0.168995 May 25 07:40:52.669717 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 276/536] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:40:52 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1407 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:40:53.559429 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-72d15f17-0d72-48ab-a213-43601f5f1880 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:53.560511 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-72d15f17-0d72-48ab-a213-43601f5f1880 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:53.562968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=56,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:53.567670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-72d15f17-0d72-48ab-a213-43601f5f1880 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:53.568117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-72d15f17-0d72-48ab-a213-43601f5f1880 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:53.568918 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-72d15f17-0d72-48ab-a213-43601f5f1880 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:53.569356 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-72d15f17-0d72-48ab-a213-43601f5f1880 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:53.598182 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-72d15f17-0d72-48ab-a213-43601f5f1880 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042676 May 25 07:40:53.598744 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 261/537] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:40:53 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 07:40:53.675100 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-2c6ddd9e-839b-44fd-aec4-1e896dd39145 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:53.675623 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-2c6ddd9e-839b-44fd-aec4-1e896dd39145 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:53.682357 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2c6ddd9e-839b-44fd-aec4-1e896dd39145 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:53.682809 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2c6ddd9e-839b-44fd-aec4-1e896dd39145 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:53.683574 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2c6ddd9e-839b-44fd-aec4-1e896dd39145 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:53.684015 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2c6ddd9e-839b-44fd-aec4-1e896dd39145 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:53.687451 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-4cf08bfb-d6fd-4439-8691-779e0945b622 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:53.688063 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-4cf08bfb-d6fd-4439-8691-779e0945b622 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:53.694351 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4cf08bfb-d6fd-4439-8691-779e0945b622 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:53.695338 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4cf08bfb-d6fd-4439-8691-779e0945b622 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:53.696106 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4cf08bfb-d6fd-4439-8691-779e0945b622 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:53.696569 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4cf08bfb-d6fd-4439-8691-779e0945b622 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:53.710058 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-2c6ddd9e-839b-44fd-aec4-1e896dd39145 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Going to try to terminate instance {{(pid=124675) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:40:53.825596 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-4cf08bfb-d6fd-4439-8691-779e0945b622 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:53.833557 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-4cf08bfb-d6fd-4439-8691-779e0945b622 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:53.835072 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-4cf08bfb-d6fd-4439-8691-779e0945b622 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:53.837058 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-4cf08bfb-d6fd-4439-8691-779e0945b622 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1407 microversion: 2.20 time: 0.153876 May 25 07:40:53.837724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 262/538] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:40:53 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:40:54.092547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-2c6ddd9e-839b-44fd-aec4-1e896dd39145 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 204 len: 0 microversion: 2.1 time: 0.420938 May 25 07:40:54.093144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 277/539] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:40:53 2022] DELETE /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 0 bytes in 422 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 07:40:54.101256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-29e5ba5f-e705-4095-bfc5-c00e1b070f7c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:54.101969 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-29e5ba5f-e705-4095-bfc5-c00e1b070f7c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:54.108796 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-29e5ba5f-e705-4095-bfc5-c00e1b070f7c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:54.109312 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-29e5ba5f-e705-4095-bfc5-c00e1b070f7c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:54.110069 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-29e5ba5f-e705-4095-bfc5-c00e1b070f7c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:54.110879 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-29e5ba5f-e705-4095-bfc5-c00e1b070f7c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:54.242307 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-29e5ba5f-e705-4095-bfc5-c00e1b070f7c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:54.249640 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-29e5ba5f-e705-4095-bfc5-c00e1b070f7c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1687 microversion: 2.1 time: 0.152379 May 25 07:40:54.250201 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 263/540] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:54 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1687 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:54.792358 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-5449bb53-4cbb-4c74-9fb9-8962cd4f9f72 req-67c95441-16d7-4a3c-80be-2971124e273c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ecec15-f302-4eea-92e6-37049703fa41", "name": "network-vif-plugged", "status": "completed", "tag": "28f4b108-96e9-447b-88dd-ed92dc19d98c"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:40:54.795901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=2 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:54.801929 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-5449bb53-4cbb-4c74-9fb9-8962cd4f9f72 req-67c95441-16d7-4a3c-80be-2971124e273c service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:54.802380 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-5449bb53-4cbb-4c74-9fb9-8962cd4f9f72 req-67c95441-16d7-4a3c-80be-2971124e273c service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:54.813478 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-5449bb53-4cbb-4c74-9fb9-8962cd4f9f72 req-67c95441-16d7-4a3c-80be-2971124e273c service nova] Creating event network-vif-plugged:28f4b108-96e9-447b-88dd-ed92dc19d98c for instance c0ecec15-f302-4eea-92e6-37049703fa41 on hv-cinder-82549 May 25 07:40:54.818194 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-5449bb53-4cbb-4c74-9fb9-8962cd4f9f72 req-67c95441-16d7-4a3c-80be-2971124e273c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030888 May 25 07:40:54.818867 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 278/541] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:40:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:40:54.855195 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-3c5cc3d3-be68-41af-9503-6926b2c1e466 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:54.855743 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-3c5cc3d3-be68-41af-9503-6926b2c1e466 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:54.858256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=6 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:54.863453 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3c5cc3d3-be68-41af-9503-6926b2c1e466 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:54.863904 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3c5cc3d3-be68-41af-9503-6926b2c1e466 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:54.864703 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3c5cc3d3-be68-41af-9503-6926b2c1e466 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:54.865141 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3c5cc3d3-be68-41af-9503-6926b2c1e466 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:54.994003 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-3c5cc3d3-be68-41af-9503-6926b2c1e466 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:55.001896 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-3c5cc3d3-be68-41af-9503-6926b2c1e466 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:55.003420 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-3c5cc3d3-be68-41af-9503-6926b2c1e466 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:55.004554 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-3c5cc3d3-be68-41af-9503-6926b2c1e466 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1407 microversion: 2.20 time: 0.154179 May 25 07:40:55.005109 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 264/542] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:40:54 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1407 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:40:55.267806 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-fee94fb9-17f4-4049-b761-a37fc139593b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:55.268524 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-fee94fb9-17f4-4049-b761-a37fc139593b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:55.275174 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fee94fb9-17f4-4049-b761-a37fc139593b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:55.275625 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fee94fb9-17f4-4049-b761-a37fc139593b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:55.276385 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fee94fb9-17f4-4049-b761-a37fc139593b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:55.276848 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fee94fb9-17f4-4049-b761-a37fc139593b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:55.403773 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-fee94fb9-17f4-4049-b761-a37fc139593b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:55.411326 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-fee94fb9-17f4-4049-b761-a37fc139593b tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1687 microversion: 2.1 time: 0.147766 May 25 07:40:55.411901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 279/543] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:55 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1687 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:56.022444 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-fd420fd9-6862-46a7-b3fd-35867141d1da tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:56.023868 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-fd420fd9-6862-46a7-b3fd-35867141d1da tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:56.030392 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fd420fd9-6862-46a7-b3fd-35867141d1da tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:56.030843 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fd420fd9-6862-46a7-b3fd-35867141d1da tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:56.031609 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fd420fd9-6862-46a7-b3fd-35867141d1da tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:56.032047 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fd420fd9-6862-46a7-b3fd-35867141d1da tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:56.167701 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-fd420fd9-6862-46a7-b3fd-35867141d1da tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:56.175618 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-fd420fd9-6862-46a7-b3fd-35867141d1da tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:56.178920 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-fd420fd9-6862-46a7-b3fd-35867141d1da tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:56.178920 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-fd420fd9-6862-46a7-b3fd-35867141d1da tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1407 microversion: 2.20 time: 0.159799 May 25 07:40:56.178920 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 265/544] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:40:56 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:40:56.429007 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4b100cbe-125e-4d79-aacc-d91820a4989f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:56.430529 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4b100cbe-125e-4d79-aacc-d91820a4989f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:56.432523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=8 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:56.438178 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4b100cbe-125e-4d79-aacc-d91820a4989f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:56.438663 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4b100cbe-125e-4d79-aacc-d91820a4989f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:56.439511 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4b100cbe-125e-4d79-aacc-d91820a4989f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:56.439958 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4b100cbe-125e-4d79-aacc-d91820a4989f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:56.572649 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4b100cbe-125e-4d79-aacc-d91820a4989f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:56.580115 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4b100cbe-125e-4d79-aacc-d91820a4989f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1687 microversion: 2.1 time: 0.155097 May 25 07:40:56.580716 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 280/545] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:56 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1687 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:57.197553 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-683e21e9-f278-4e84-9a63-57d49fd4ffa8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:57.198166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-683e21e9-f278-4e84-9a63-57d49fd4ffa8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:57.204524 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-683e21e9-f278-4e84-9a63-57d49fd4ffa8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:57.204970 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-683e21e9-f278-4e84-9a63-57d49fd4ffa8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:57.205725 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-683e21e9-f278-4e84-9a63-57d49fd4ffa8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:57.206155 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-683e21e9-f278-4e84-9a63-57d49fd4ffa8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:57.221348 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=96,nova_cell1:UPDATE=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:40:57.336820 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-683e21e9-f278-4e84-9a63-57d49fd4ffa8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:57.344830 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-683e21e9-f278-4e84-9a63-57d49fd4ffa8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:57.346341 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-683e21e9-f278-4e84-9a63-57d49fd4ffa8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:57.347514 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-683e21e9-f278-4e84-9a63-57d49fd4ffa8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1407 microversion: 2.20 time: 0.154657 May 25 07:40:57.348102 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 266/546] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:40:57 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1407 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:40:57.597859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-642a8e52-0082-4008-a627-d012772e2315 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:57.598473 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-642a8e52-0082-4008-a627-d012772e2315 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:57.605128 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-642a8e52-0082-4008-a627-d012772e2315 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:57.605580 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-642a8e52-0082-4008-a627-d012772e2315 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:57.606384 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-642a8e52-0082-4008-a627-d012772e2315 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:57.606833 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-642a8e52-0082-4008-a627-d012772e2315 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:57.737196 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-642a8e52-0082-4008-a627-d012772e2315 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:57.745795 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-642a8e52-0082-4008-a627-d012772e2315 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1687 microversion: 2.1 time: 0.151803 May 25 07:40:57.746377 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 281/547] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:57 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1687 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:40:58.376075 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7129dd2a-ab39-4131-9d36-3a81aa7b10b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:58.376713 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-7129dd2a-ab39-4131-9d36-3a81aa7b10b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:58.384697 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7129dd2a-ab39-4131-9d36-3a81aa7b10b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:58.385163 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7129dd2a-ab39-4131-9d36-3a81aa7b10b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:58.386009 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7129dd2a-ab39-4131-9d36-3a81aa7b10b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:58.386396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7129dd2a-ab39-4131-9d36-3a81aa7b10b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:58.625196 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7129dd2a-ab39-4131-9d36-3a81aa7b10b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:58.634590 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7129dd2a-ab39-4131-9d36-3a81aa7b10b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:58.635377 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7129dd2a-ab39-4131-9d36-3a81aa7b10b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:58.636559 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-7129dd2a-ab39-4131-9d36-3a81aa7b10b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1407 microversion: 2.20 time: 0.266743 May 25 07:40:58.637313 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 267/548] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:40:58 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1407 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:40:58.763324 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-db33ce72-e60e-4ec0-a464-dc55bab782f7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:58.764050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-db33ce72-e60e-4ec0-a464-dc55bab782f7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:58.770584 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-db33ce72-e60e-4ec0-a464-dc55bab782f7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:58.771120 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-db33ce72-e60e-4ec0-a464-dc55bab782f7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:58.771897 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-db33ce72-e60e-4ec0-a464-dc55bab782f7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:58.772339 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-db33ce72-e60e-4ec0-a464-dc55bab782f7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:58.918507 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-db33ce72-e60e-4ec0-a464-dc55bab782f7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:58.926088 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-db33ce72-e60e-4ec0-a464-dc55bab782f7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1687 microversion: 2.1 time: 0.166671 May 25 07:40:58.926658 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 282/549] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:58 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1687 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:40:59.151042 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-56b8dd9d-0eee-40b5-ba93-9170ed784696 req-f445773e-3c99-4719-9117-a15500b405ab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5ef563c-52c0-40b3-bdf3-dc51e5422196", "name": "network-vif-deleted", "tag": "0747a8fb-24f2-4911-87f0-c806befeeab7"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:40:59.166748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-56b8dd9d-0eee-40b5-ba93-9170ed784696 req-f445773e-3c99-4719-9117-a15500b405ab service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:59.167196 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-56b8dd9d-0eee-40b5-ba93-9170ed784696 req-f445773e-3c99-4719-9117-a15500b405ab service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:59.178380 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-56b8dd9d-0eee-40b5-ba93-9170ed784696 req-f445773e-3c99-4719-9117-a15500b405ab service nova] Creating event network-vif-deleted:0747a8fb-24f2-4911-87f0-c806befeeab7 for instance a5ef563c-52c0-40b3-bdf3-dc51e5422196 on hv-cinder-82549 May 25 07:40:59.183875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-56b8dd9d-0eee-40b5-ba93-9170ed784696 req-f445773e-3c99-4719-9117-a15500b405ab service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037304 May 25 07:40:59.184550 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 268/550] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:40:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:40:59.654861 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-1028da36-76e8-4c43-9f24-1fcc6f9eedcb tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:59.655481 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-1028da36-76e8-4c43-9f24-1fcc6f9eedcb tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:59.662403 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1028da36-76e8-4c43-9f24-1fcc6f9eedcb tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:59.662857 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1028da36-76e8-4c43-9f24-1fcc6f9eedcb tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:59.664178 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1028da36-76e8-4c43-9f24-1fcc6f9eedcb tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:59.664968 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1028da36-76e8-4c43-9f24-1fcc6f9eedcb tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:59.800280 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-1028da36-76e8-4c43-9f24-1fcc6f9eedcb tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:59.808979 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-1028da36-76e8-4c43-9f24-1fcc6f9eedcb tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:59.813622 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-1028da36-76e8-4c43-9f24-1fcc6f9eedcb tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:40:59.813622 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-1028da36-76e8-4c43-9f24-1fcc6f9eedcb tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1407 microversion: 2.20 time: 0.160928 May 25 07:40:59.813622 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 283/551] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:40:59 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:40:59.944198 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-a61ff93e-0990-4955-b40d-938f0c00a0be tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:40:59.944948 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-a61ff93e-0990-4955-b40d-938f0c00a0be tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:40:59.952096 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a61ff93e-0990-4955-b40d-938f0c00a0be tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:59.952587 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a61ff93e-0990-4955-b40d-938f0c00a0be tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:59.953352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a61ff93e-0990-4955-b40d-938f0c00a0be tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:59.953774 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a61ff93e-0990-4955-b40d-938f0c00a0be tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:59.986672 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a61ff93e-0990-4955-b40d-938f0c00a0be tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:40:59.987162 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a61ff93e-0990-4955-b40d-938f0c00a0be tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:40:59.987643 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.objects.instance [None req-a61ff93e-0990-4955-b40d-938f0c00a0be tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lazy-loading 'fault' on Instance uuid a5ef563c-52c0-40b3-bdf3-dc51e5422196 {{(pid=124674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:41:00.037538 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a61ff93e-0990-4955-b40d-938f0c00a0be tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:00.045619 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-a61ff93e-0990-4955-b40d-938f0c00a0be tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 200 len: 1335 microversion: 2.1 time: 0.106024 May 25 07:41:00.046214 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 269/552] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:40:59 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 1335 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:00.830176 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8985e68a-4af2-4e89-bb98-9f497a9541d5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:00.830826 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-8985e68a-4af2-4e89-bb98-9f497a9541d5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:00.838098 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8985e68a-4af2-4e89-bb98-9f497a9541d5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:00.838554 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8985e68a-4af2-4e89-bb98-9f497a9541d5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:00.839327 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8985e68a-4af2-4e89-bb98-9f497a9541d5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:00.839768 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8985e68a-4af2-4e89-bb98-9f497a9541d5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:00.908438 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-166362b3-601b-4712-acab-5c6b18029ab0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:00.909394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-166362b3-601b-4712-acab-5c6b18029ab0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:00.916238 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-166362b3-601b-4712-acab-5c6b18029ab0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:00.916793 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-166362b3-601b-4712-acab-5c6b18029ab0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:00.918751 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-166362b3-601b-4712-acab-5c6b18029ab0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:00.919274 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-166362b3-601b-4712-acab-5c6b18029ab0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:00.950473 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-166362b3-601b-4712-acab-5c6b18029ab0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046036 May 25 07:41:00.951406 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 270/553] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:41:00 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) May 25 07:41:00.979742 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-8985e68a-4af2-4e89-bb98-9f497a9541d5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:00.988861 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-8985e68a-4af2-4e89-bb98-9f497a9541d5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:00.995548 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-8985e68a-4af2-4e89-bb98-9f497a9541d5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:00.997521 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-8985e68a-4af2-4e89-bb98-9f497a9541d5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1599 microversion: 2.20 time: 0.170522 May 25 07:41:01.005011 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 284/554] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:41:00 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1599 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:41:01.020264 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-efeb7f72-7ced-47b5-a434-b01439fb041b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:01.020835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-efeb7f72-7ced-47b5-a434-b01439fb041b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:01.020987 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-9b8165d9-cd04-4a93-ab58-e6810aa585e2 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:01.021594 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-9b8165d9-cd04-4a93-ab58-e6810aa585e2 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:01.027834 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9b8165d9-cd04-4a93-ab58-e6810aa585e2 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:01.028290 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9b8165d9-cd04-4a93-ab58-e6810aa585e2 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:01.028621 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-efeb7f72-7ced-47b5-a434-b01439fb041b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:01.029085 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-efeb7f72-7ced-47b5-a434-b01439fb041b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:01.029206 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9b8165d9-cd04-4a93-ab58-e6810aa585e2 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:01.029525 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9b8165d9-cd04-4a93-ab58-e6810aa585e2 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:01.029871 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-efeb7f72-7ced-47b5-a434-b01439fb041b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:01.030318 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-efeb7f72-7ced-47b5-a434-b01439fb041b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:01.068716 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-efeb7f72-7ced-47b5-a434-b01439fb041b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Going to try to terminate instance {{(pid=124674) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:41:01.118304 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-9b8165d9-cd04-4a93-ab58-e6810aa585e2 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.101101 May 25 07:41:01.118905 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 285/555] 10.222.0.24 () {60 vars in 1315 bytes} [Wed May 25 07:41:01 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 07:41:01.123568 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-2fbee4fb-65f0-4833-8212-db01a90a33fe tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:01.124180 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-2fbee4fb-65f0-4833-8212-db01a90a33fe tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: a5ef563c-52c0-40b3-bdf3-dc51e5422196] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:01.130417 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2fbee4fb-65f0-4833-8212-db01a90a33fe tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:01.130881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2fbee4fb-65f0-4833-8212-db01a90a33fe tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:01.131655 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2fbee4fb-65f0-4833-8212-db01a90a33fe tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:01.132111 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2fbee4fb-65f0-4833-8212-db01a90a33fe tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:01.146434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-2fbee4fb-65f0-4833-8212-db01a90a33fe tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] HTTP exception thrown: Instance a5ef563c-52c0-40b3-bdf3-dc51e5422196 could not be found. May 25 07:41:01.148767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-2fbee4fb-65f0-4833-8212-db01a90a33fe tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Request method failure captured: May 25 07:41:01.148767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 HTTP/1.1 May 25 07:41:01.148767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:41:01.148767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:41:01.148767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:41:01.148767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:41:01.148767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:41:01.148767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:41:01.148767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:41:01.148767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:41:01.148767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijdyGuqDe3p06hkpp6ohyIkCZkEMZD-Xm9k8dFGeecHnJxdqekCaABg8wzmfOAlxn-W8UpasXr7XYWqwQfoR7IZRkPp3JQjBoqqqadXk1ODtfCJewTnu7WrLyB1br2CZbFtQzX_dfu8qpnIIdjcBpxB5N_NNozK67UOqIu_ddo6FZg-U May 25 07:41:01.148767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:41:01.148767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:41:01.148767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:41:01.148767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:41:01.148767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:41:01.148767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:41:01.148767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: d4719a4804e24f27b9427e58c5cbe13b May 25 07:41:01.148767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-274124411 May 25 07:41:01.148767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:41:01.148767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:41:01.150498 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d4719a4804e24f27b9427e58c5cbe13b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/d4719a4804e24f27b9427e58c5cbe13b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_d4719a4804e24f27b9427e58c5cbe13b", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d4719a4804e24f27b9427e58c5cbe13b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:41:01.150498 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-ServerRescueNegativeTestJSON-274124411 May 25 07:41:01.150498 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: d4719a4804e24f27b9427e58c5cbe13b May 25 07:41:01.150498 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-274124411 May 25 07:41:01.150498 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-ServerRescueNegativeTestJSON-274124411-project May 25 07:41:01.150498 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:41:01.150498 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:41:01.150498 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: f90f0f6afda54e80bc319dc5bdb80ea6 May 25 07:41:01.150498 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-ServerRescueNegativeTestJSON-274124411-project May 25 07:41:01.150498 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:41:01.150498 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance a5ef563c-52c0-40b3-bdf3-dc51e5422196 could not be found. May 25 07:41:01.150498 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': 'a5ef563c-52c0-40b3-bdf3-dc51e5422196'} May 25 07:41:01.154539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:41:01.154539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:41:01.154539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:41:01.154539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:41:01.154539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:41:01.154539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:41:01.154539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:41:01.154539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:41:01.154539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:41:01.154539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:41:01.154539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5ef563c-52c0-40b3-bdf3-dc51e5422196 could not be found. May 25 07:41:01.154539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:41:01.154539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:41:01.154539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:41:01.154539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:41:01.154539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:41:01.154539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:41:01.154539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:41:01.154539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:41:01.154539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:41:01.156539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:41:01.156539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:41:01.156539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:41:01.156539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:41:01.156539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:41:01.156539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:41:01.156539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:41:01.156539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5ef563c-52c0-40b3-bdf3-dc51e5422196 could not be found. May 25 07:41:01.156539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:41:01.156539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:41:01.156539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:41:01.156539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:41:01.156539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:41:01.156539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:41:01.156539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:41:01.156539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:41:01.156539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5ef563c-52c0-40b3-bdf3-dc51e5422196 could not be found. May 25 07:41:01.156539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:41:01.158848 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-2fbee4fb-65f0-4833-8212-db01a90a33fe tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Returning 404 to user: Instance a5ef563c-52c0-40b3-bdf3-dc51e5422196 could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:41:01.158848 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-2fbee4fb-65f0-4833-8212-db01a90a33fe tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196" status: 404 len: 111 microversion: 2.1 time: 0.030172 May 25 07:41:01.158848 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 286/556] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:01 2022] GET /compute/v2.1/servers/a5ef563c-52c0-40b3-bdf3-dc51e5422196 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:41:01.158848 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-9a80a951-2165-4107-a8d9-2e60cd0ff469 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '.version_select at 0x7fc86423bd30>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:01.251372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-9a80a951-2165-4107-a8d9-2e60cd0ff469 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-657521390" status: 202 len: 0 microversion: 2.1 time: 0.096435 May 25 07:41:01.252097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 287/557] 10.222.0.24 () {58 vars in 1217 bytes} [Wed May 25 07:41:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-657521390 => generated 0 bytes in 98 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 07:41:01.407105 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-efeb7f72-7ced-47b5-a434-b01439fb041b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 204 len: 0 microversion: 2.1 time: 0.390717 May 25 07:41:01.407730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 271/558] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:41:01 2022] DELETE /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 0 bytes in 392 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 07:41:01.416915 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-910a8558-0927-4e5d-8585-1587162858ce tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:01.417536 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-910a8558-0927-4e5d-8585-1587162858ce tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:01.424104 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-910a8558-0927-4e5d-8585-1587162858ce tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:01.424584 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-910a8558-0927-4e5d-8585-1587162858ce tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:01.425370 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-910a8558-0927-4e5d-8585-1587162858ce tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:01.425806 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-910a8558-0927-4e5d-8585-1587162858ce tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:01.863750 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-910a8558-0927-4e5d-8585-1587162858ce tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:01.866066 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:01.872911 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-910a8558-0927-4e5d-8585-1587162858ce tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1673 microversion: 2.1 time: 0.460422 May 25 07:41:01.873581 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 288/559] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:01 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1673 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:02.501482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-a99511f0-91ca-458b-b724-8da1cbefcd6f req-4f033e43-ec02-4ec5-a854-0e07c8cafd09 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c0ecec15-f302-4eea-92e6-37049703fa41", "tag": "28f4b108-96e9-447b-88dd-ed92dc19d98c"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:41:02.510614 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-a99511f0-91ca-458b-b724-8da1cbefcd6f req-4f033e43-ec02-4ec5-a854-0e07c8cafd09 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:02.511054 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-a99511f0-91ca-458b-b724-8da1cbefcd6f req-4f033e43-ec02-4ec5-a854-0e07c8cafd09 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:02.521972 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-a99511f0-91ca-458b-b724-8da1cbefcd6f req-4f033e43-ec02-4ec5-a854-0e07c8cafd09 service nova] Creating event network-changed:28f4b108-96e9-447b-88dd-ed92dc19d98c for instance c0ecec15-f302-4eea-92e6-37049703fa41 on hv-cinder-82549 May 25 07:41:02.527349 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-a99511f0-91ca-458b-b724-8da1cbefcd6f req-4f033e43-ec02-4ec5-a854-0e07c8cafd09 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029957 May 25 07:41:02.527940 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 272/560] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:41:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:41:02.892392 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-c251e340-09a0-4fbe-b71b-b69d51273149 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:02.893649 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-c251e340-09a0-4fbe-b71b-b69d51273149 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:02.901212 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c251e340-09a0-4fbe-b71b-b69d51273149 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:02.901751 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c251e340-09a0-4fbe-b71b-b69d51273149 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:02.902534 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c251e340-09a0-4fbe-b71b-b69d51273149 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:02.902975 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c251e340-09a0-4fbe-b71b-b69d51273149 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:03.035069 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-c251e340-09a0-4fbe-b71b-b69d51273149 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:03.043300 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-c251e340-09a0-4fbe-b71b-b69d51273149 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1673 microversion: 2.1 time: 0.155958 May 25 07:41:03.043981 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 289/561] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:02 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1673 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:04.061679 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-9b823974-cd3e-44ac-8911-62274897a5cb tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:04.062406 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-9b823974-cd3e-44ac-8911-62274897a5cb tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:04.068540 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9b823974-cd3e-44ac-8911-62274897a5cb tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:04.068987 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9b823974-cd3e-44ac-8911-62274897a5cb tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:04.070307 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9b823974-cd3e-44ac-8911-62274897a5cb tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:04.070951 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9b823974-cd3e-44ac-8911-62274897a5cb tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:04.410843 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9b823974-cd3e-44ac-8911-62274897a5cb tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:04.418563 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-9b823974-cd3e-44ac-8911-62274897a5cb tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1673 microversion: 2.1 time: 0.361566 May 25 07:41:04.428310 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 273/562] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:04 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1673 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:04.683080 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-40e0775c-92c7-4d6a-a4f5-45afeaa986f4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:04.683715 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-40e0775c-92c7-4d6a-a4f5-45afeaa986f4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:04.691682 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-40e0775c-92c7-4d6a-a4f5-45afeaa986f4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:04.692141 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-40e0775c-92c7-4d6a-a4f5-45afeaa986f4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:04.693010 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-40e0775c-92c7-4d6a-a4f5-45afeaa986f4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:04.693480 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-40e0775c-92c7-4d6a-a4f5-45afeaa986f4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:04.720000 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-40e0775c-92c7-4d6a-a4f5-45afeaa986f4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Going to try to terminate instance {{(pid=124675) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:41:05.096105 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-40e0775c-92c7-4d6a-a4f5-45afeaa986f4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 204 len: 0 microversion: 2.1 time: 0.417845 May 25 07:41:05.097018 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 290/563] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:41:04 2022] DELETE /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 07:41:05.105161 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-0ed5329f-b536-4b1a-a69c-4b2bdc0faca7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:05.105778 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-0ed5329f-b536-4b1a-a69c-4b2bdc0faca7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:05.112813 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0ed5329f-b536-4b1a-a69c-4b2bdc0faca7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:05.113259 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0ed5329f-b536-4b1a-a69c-4b2bdc0faca7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:05.114026 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0ed5329f-b536-4b1a-a69c-4b2bdc0faca7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:05.114483 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0ed5329f-b536-4b1a-a69c-4b2bdc0faca7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:05.228845 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-fef9b1f1-b632-4802-8b53-003f253193cc req-5f3cfd3e-6dbe-4a01-b300-a50c03ac1252 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a8b10bee-95b1-4bfb-a9c5-6c15db78ba25", "name": "network-vif-deleted", "tag": "afc7174b-1940-457e-9abc-fe45a8d98d61"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:41:05.238193 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-fef9b1f1-b632-4802-8b53-003f253193cc req-5f3cfd3e-6dbe-4a01-b300-a50c03ac1252 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:05.239114 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-fef9b1f1-b632-4802-8b53-003f253193cc req-5f3cfd3e-6dbe-4a01-b300-a50c03ac1252 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:05.253164 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-fef9b1f1-b632-4802-8b53-003f253193cc req-5f3cfd3e-6dbe-4a01-b300-a50c03ac1252 service nova] Creating event network-vif-deleted:afc7174b-1940-457e-9abc-fe45a8d98d61 for instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 on hv-cinder-82549 May 25 07:41:05.258846 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-fef9b1f1-b632-4802-8b53-003f253193cc req-5f3cfd3e-6dbe-4a01-b300-a50c03ac1252 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034612 May 25 07:41:05.262785 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 291/564] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:41:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:41:05.299243 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-0ed5329f-b536-4b1a-a69c-4b2bdc0faca7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:05.309508 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-0ed5329f-b536-4b1a-a69c-4b2bdc0faca7 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1505 microversion: 2.1 time: 0.208213 May 25 07:41:05.310508 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 274/565] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:05 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1505 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:05.436712 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-7fb90890-112c-47d8-90a7-31a56f5ecefa tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:05.437423 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-7fb90890-112c-47d8-90a7-31a56f5ecefa tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:05.443814 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7fb90890-112c-47d8-90a7-31a56f5ecefa tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:05.444269 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7fb90890-112c-47d8-90a7-31a56f5ecefa tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:05.445129 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7fb90890-112c-47d8-90a7-31a56f5ecefa tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:05.445568 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7fb90890-112c-47d8-90a7-31a56f5ecefa tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:05.512836 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-7fb90890-112c-47d8-90a7-31a56f5ecefa tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:05.521129 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-7fb90890-112c-47d8-90a7-31a56f5ecefa tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1605 microversion: 2.1 time: 0.088797 May 25 07:41:05.521755 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 292/566] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:05 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1605 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:06.328258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c86422a1-b0e1-4fbe-9713-44da1b267f34 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:06.328806 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c86422a1-b0e1-4fbe-9713-44da1b267f34 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:06.335744 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c86422a1-b0e1-4fbe-9713-44da1b267f34 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:06.336827 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c86422a1-b0e1-4fbe-9713-44da1b267f34 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:06.337612 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c86422a1-b0e1-4fbe-9713-44da1b267f34 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:06.338050 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c86422a1-b0e1-4fbe-9713-44da1b267f34 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:06.465365 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c86422a1-b0e1-4fbe-9713-44da1b267f34 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:06.472765 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c86422a1-b0e1-4fbe-9713-44da1b267f34 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1505 microversion: 2.1 time: 0.149355 May 25 07:41:06.473338 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 275/567] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:06 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1505 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:06.538477 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-6b8895ee-e787-49df-8020-01321800f201 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:06.539173 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-6b8895ee-e787-49df-8020-01321800f201 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:06.545684 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6b8895ee-e787-49df-8020-01321800f201 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:06.546135 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6b8895ee-e787-49df-8020-01321800f201 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:06.546897 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6b8895ee-e787-49df-8020-01321800f201 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:06.547343 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6b8895ee-e787-49df-8020-01321800f201 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:06.608742 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-6b8895ee-e787-49df-8020-01321800f201 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:06.616966 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-6b8895ee-e787-49df-8020-01321800f201 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1605 microversion: 2.1 time: 0.081835 May 25 07:41:06.617540 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 293/568] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:06 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1605 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:07.490165 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-39c5e57a-c0c2-4314-9671-4f1358a982a5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:07.491319 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-39c5e57a-c0c2-4314-9671-4f1358a982a5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:07.497901 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-39c5e57a-c0c2-4314-9671-4f1358a982a5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:07.498356 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-39c5e57a-c0c2-4314-9671-4f1358a982a5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:07.499936 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-39c5e57a-c0c2-4314-9671-4f1358a982a5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:07.499936 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-39c5e57a-c0c2-4314-9671-4f1358a982a5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:07.634314 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ffad3469-20f2-4407-9e85-d1a11cb4e907 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:07.635367 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ffad3469-20f2-4407-9e85-d1a11cb4e907 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:07.639166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-39c5e57a-c0c2-4314-9671-4f1358a982a5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:07.646965 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-39c5e57a-c0c2-4314-9671-4f1358a982a5 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1505 microversion: 2.1 time: 0.160919 May 25 07:41:07.649435 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 276/569] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:07 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:07.649583 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ffad3469-20f2-4407-9e85-d1a11cb4e907 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:07.649993 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ffad3469-20f2-4407-9e85-d1a11cb4e907 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:07.650890 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ffad3469-20f2-4407-9e85-d1a11cb4e907 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:07.651334 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ffad3469-20f2-4407-9e85-d1a11cb4e907 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:07.694008 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ffad3469-20f2-4407-9e85-d1a11cb4e907 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:07.694472 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ffad3469-20f2-4407-9e85-d1a11cb4e907 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:07.695564 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.objects.instance [None req-ffad3469-20f2-4407-9e85-d1a11cb4e907 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lazy-loading 'fault' on Instance uuid a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 {{(pid=124675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:41:07.738059 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ffad3469-20f2-4407-9e85-d1a11cb4e907 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:07.746676 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ffad3469-20f2-4407-9e85-d1a11cb4e907 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 200 len: 1327 microversion: 2.1 time: 0.116277 May 25 07:41:07.747328 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 294/570] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:07 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 1327 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:41:08.161277 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-8b75f6fa-43cc-4af6-8d84-d8e360ce8a17 req-7dbfb41a-0323-4f5d-9b55-70b917728bc8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "f652bc42-42f2-4664-b614-603b3ddf84b1", "name": "network-vif-deleted", "tag": "5d521607-ce1e-41b4-a067-fdc197d09700"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:41:08.170811 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-8b75f6fa-43cc-4af6-8d84-d8e360ce8a17 req-7dbfb41a-0323-4f5d-9b55-70b917728bc8 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:08.171376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-8b75f6fa-43cc-4af6-8d84-d8e360ce8a17 req-7dbfb41a-0323-4f5d-9b55-70b917728bc8 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:08.183358 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-8b75f6fa-43cc-4af6-8d84-d8e360ce8a17 req-7dbfb41a-0323-4f5d-9b55-70b917728bc8 service nova] Creating event network-vif-deleted:5d521607-ce1e-41b4-a067-fdc197d09700 for instance f652bc42-42f2-4664-b614-603b3ddf84b1 on hv-cinder-82549 May 25 07:41:08.188851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-8b75f6fa-43cc-4af6-8d84-d8e360ce8a17 req-7dbfb41a-0323-4f5d-9b55-70b917728bc8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031184 May 25 07:41:08.189630 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 277/571] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:41:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:41:08.664853 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-d8a234ac-5dd9-44d1-b3ac-56aa892bcc09 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:08.665489 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-d8a234ac-5dd9-44d1-b3ac-56aa892bcc09 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:08.673441 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d8a234ac-5dd9-44d1-b3ac-56aa892bcc09 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:08.673972 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d8a234ac-5dd9-44d1-b3ac-56aa892bcc09 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:08.674814 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d8a234ac-5dd9-44d1-b3ac-56aa892bcc09 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:08.675318 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d8a234ac-5dd9-44d1-b3ac-56aa892bcc09 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:08.710918 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d8a234ac-5dd9-44d1-b3ac-56aa892bcc09 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:08.711244 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d8a234ac-5dd9-44d1-b3ac-56aa892bcc09 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:08.711722 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.objects.instance [None req-d8a234ac-5dd9-44d1-b3ac-56aa892bcc09 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lazy-loading 'fault' on Instance uuid f652bc42-42f2-4664-b614-603b3ddf84b1 {{(pid=124675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:41:08.753025 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d8a234ac-5dd9-44d1-b3ac-56aa892bcc09 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:08.761894 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-d8a234ac-5dd9-44d1-b3ac-56aa892bcc09 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 200 len: 1312 microversion: 2.1 time: 0.100985 May 25 07:41:08.762812 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 295/572] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:08 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 1312 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:08.766596 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d0ed2fcc-fbcc-4d4b-b729-72f4041242b9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:08.768036 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d0ed2fcc-fbcc-4d4b-b729-72f4041242b9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:08.776703 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d0ed2fcc-fbcc-4d4b-b729-72f4041242b9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:08.777173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d0ed2fcc-fbcc-4d4b-b729-72f4041242b9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:08.777967 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d0ed2fcc-fbcc-4d4b-b729-72f4041242b9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:08.778409 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d0ed2fcc-fbcc-4d4b-b729-72f4041242b9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:08.794223 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-d0ed2fcc-fbcc-4d4b-b729-72f4041242b9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] HTTP exception thrown: Instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 could not be found. May 25 07:41:08.796020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d0ed2fcc-fbcc-4d4b-b729-72f4041242b9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Request method failure captured: May 25 07:41:08.796020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 HTTP/1.1 May 25 07:41:08.796020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:41:08.796020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:41:08.796020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:41:08.796020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:41:08.796020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:41:08.796020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:41:08.796020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:41:08.796020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:41:08.796020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdyNCjLy2qS9UhuPFuxBEq0FiclBvFD7JXrP14IWxENy6hbyxVEhXn--e--hqL5koIKvDVkaoHL9YjzaGGDLXh0Se_STUU_WMcqzc9izwYyxL1z8xYZKymgWf-6TyQiFw0RMMPsbea_1WKtaVVL73UJd08NiWUcJxWKAgjVdqvEgEvY May 25 07:41:08.796020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:41:08.796020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:41:08.796020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:41:08.796020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:41:08.796020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:41:08.796020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:41:08.796020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: 294afe2c36184564a80fb6bef7b32359 May 25 07:41:08.796020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-AttachVolumeTestJSON-631109292 May 25 07:41:08.796020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:41:08.796020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:41:08.797582 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/294afe2c36184564a80fb6bef7b32359"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/294afe2c36184564a80fb6bef7b32359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_294afe2c36184564a80fb6bef7b32359", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/294afe2c36184564a80fb6bef7b32359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:41:08.797582 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-AttachVolumeTestJSON-631109292 May 25 07:41:08.797582 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: 294afe2c36184564a80fb6bef7b32359 May 25 07:41:08.797582 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-AttachVolumeTestJSON-631109292 May 25 07:41:08.797582 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-AttachVolumeTestJSON-631109292-project May 25 07:41:08.797582 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:41:08.797582 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:41:08.797582 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: 28d83ef95cda448dbd72acbd13a5f008 May 25 07:41:08.797582 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-AttachVolumeTestJSON-631109292-project May 25 07:41:08.797582 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:41:08.797582 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 could not be found. May 25 07:41:08.797582 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': 'a8b10bee-95b1-4bfb-a9c5-6c15db78ba25'} May 25 07:41:08.798474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:41:08.798474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:41:08.798474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:41:08.798474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:41:08.798474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:41:08.798474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:41:08.798474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:41:08.798474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:41:08.798474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:41:08.798474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:41:08.798474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 could not be found. May 25 07:41:08.798474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:41:08.798474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:41:08.798474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:41:08.798474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:41:08.798474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:41:08.798474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:41:08.798474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:41:08.798474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:41:08.798474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:41:08.799724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:41:08.799724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:41:08.799724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:41:08.799724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:41:08.799724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:41:08.799724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:41:08.799724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:41:08.799724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 could not be found. May 25 07:41:08.799724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:41:08.799724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:41:08.799724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:41:08.799724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:41:08.799724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:41:08.799724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:41:08.799724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:41:08.799724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:41:08.799724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 could not be found. May 25 07:41:08.799724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:41:08.800811 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d0ed2fcc-fbcc-4d4b-b729-72f4041242b9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Returning 404 to user: Instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:41:08.800811 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d0ed2fcc-fbcc-4d4b-b729-72f4041242b9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 404 len: 111 microversion: 2.1 time: 0.036493 May 25 07:41:08.800811 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 278/573] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:08 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:41:08.807884 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-bbd5db93-4135-46e2-95cd-c6a43d1b6a84 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '.version_select at 0x7fc8641fcb80>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:08.893588 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-bbd5db93-4135-46e2-95cd-c6a43d1b6a84 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1252439530" status: 202 len: 0 microversion: 2.1 time: 0.090297 May 25 07:41:08.894093 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 296/574] 10.222.0.24 () {58 vars in 1220 bytes} [Wed May 25 07:41:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1252439530 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:41:09.779035 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-9bb15b7c-ed3e-4b46-9d3d-4c6bd19b7f97 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:09.793487 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-9bb15b7c-ed3e-4b46-9d3d-4c6bd19b7f97 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: f652bc42-42f2-4664-b614-603b3ddf84b1] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:09.793638 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b75ad942-7578-4d71-9017-855f7d4f93a0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Action: 'create', calling method: .version_select at 0x7fc8641d6c10>, body: {"keypair": {"name": "tempest-keypair-1409151964", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEhsNhttvElVNRVOwR5JZpteJY3fIUiqcxtThr60IEHCiW7KcqaoVLakd091YquExqkwos3ncRebJeMkcwZxShY159MlBS1oypw4iI1+CfW5ni/NFHnXpWt6GrzObOvBhw=="}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:41:09.794102 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9bb15b7c-ed3e-4b46-9d3d-4c6bd19b7f97 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:09.794102 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9bb15b7c-ed3e-4b46-9d3d-4c6bd19b7f97 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:09.794102 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9bb15b7c-ed3e-4b46-9d3d-4c6bd19b7f97 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:09.794102 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9bb15b7c-ed3e-4b46-9d3d-4c6bd19b7f97 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:09.794606 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-b75ad942-7578-4d71-9017-855f7d4f93a0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Getting quotas for project 294afe2c36184564a80fb6bef7b32359. Resources: {'key_pairs'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:41:09.798452 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-b75ad942-7578-4d71-9017-855f7d4f93a0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Getting quotas for user 28d83ef95cda448dbd72acbd13a5f008 and project 294afe2c36184564a80fb6bef7b32359. Resources: {'key_pairs'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:41:09.801810 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-9bb15b7c-ed3e-4b46-9d3d-4c6bd19b7f97 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] HTTP exception thrown: Instance f652bc42-42f2-4664-b614-603b3ddf84b1 could not be found. May 25 07:41:09.803329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-9bb15b7c-ed3e-4b46-9d3d-4c6bd19b7f97 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Request method failure captured: May 25 07:41:09.803329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 HTTP/1.1 May 25 07:41:09.803329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:41:09.803329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:41:09.803329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:41:09.803329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:41:09.803329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:41:09.803329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:41:09.803329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:41:09.803329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:41:09.803329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdyGuqDe3p06hkpp6ohyIkCZkEMZD-Xm9k8dFGeecHnJxdqekCaABg8wzmfOAlxn-W8UpasXr7XYWqwQfoR7IZRkPp3JQjBoqqqadXk1ODtfCJewTnu7WrLyB1br2CZbFtQzX_dfu8qpnIIdjcBpxB5N_NNozK67UOqIu_ddo6FZg-U May 25 07:41:09.803329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:41:09.803329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:41:09.803329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:41:09.803329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:41:09.803329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:41:09.803329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:41:09.803329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: d4719a4804e24f27b9427e58c5cbe13b May 25 07:41:09.803329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-274124411 May 25 07:41:09.803329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:41:09.803329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:41:09.804776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d4719a4804e24f27b9427e58c5cbe13b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/d4719a4804e24f27b9427e58c5cbe13b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_d4719a4804e24f27b9427e58c5cbe13b", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d4719a4804e24f27b9427e58c5cbe13b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:41:09.804776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-ServerRescueNegativeTestJSON-274124411 May 25 07:41:09.804776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: d4719a4804e24f27b9427e58c5cbe13b May 25 07:41:09.804776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-274124411 May 25 07:41:09.804776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-ServerRescueNegativeTestJSON-274124411-project May 25 07:41:09.804776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:41:09.804776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:41:09.804776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: f90f0f6afda54e80bc319dc5bdb80ea6 May 25 07:41:09.804776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-ServerRescueNegativeTestJSON-274124411-project May 25 07:41:09.804776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:41:09.804776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Instance f652bc42-42f2-4664-b614-603b3ddf84b1 could not be found. May 25 07:41:09.804776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': 'f652bc42-42f2-4664-b614-603b3ddf84b1'} May 25 07:41:09.805521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:41:09.805521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:41:09.805521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:41:09.805521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:41:09.805521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:41:09.805521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:41:09.805521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:41:09.805521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:41:09.805521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:41:09.805521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:41:09.805521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f652bc42-42f2-4664-b614-603b3ddf84b1 could not be found. May 25 07:41:09.805521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:41:09.805521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:41:09.805521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:41:09.805521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:41:09.805521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:41:09.805521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:41:09.805521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:41:09.805521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:41:09.805521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:41:09.807173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:41:09.807173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:41:09.807173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:41:09.807173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:41:09.807173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:41:09.807173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:41:09.807173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:41:09.807173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f652bc42-42f2-4664-b614-603b3ddf84b1 could not be found. May 25 07:41:09.807173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:41:09.807173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:41:09.807173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:41:09.807173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:41:09.807173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:41:09.807173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:41:09.807173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:41:09.807173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:41:09.807173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f652bc42-42f2-4664-b614-603b3ddf84b1 could not be found. May 25 07:41:09.807173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:41:09.808572 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-9bb15b7c-ed3e-4b46-9d3d-4c6bd19b7f97 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Returning 404 to user: Instance f652bc42-42f2-4664-b614-603b3ddf84b1 could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:41:09.808572 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-9bb15b7c-ed3e-4b46-9d3d-4c6bd19b7f97 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1" status: 404 len: 111 microversion: 2.1 time: 0.029818 May 25 07:41:09.808572 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 279/575] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:09 2022] GET /compute/v2.1/servers/f652bc42-42f2-4664-b614-603b3ddf84b1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:41:09.813828 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-35559437-3a64-4d85-9219-aef3913bda6f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:09.814315 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-35559437-3a64-4d85-9219-aef3913bda6f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:09.820320 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-35559437-3a64-4d85-9219-aef3913bda6f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:09.820800 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-35559437-3a64-4d85-9219-aef3913bda6f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:09.821567 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-35559437-3a64-4d85-9219-aef3913bda6f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:09.822113 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-35559437-3a64-4d85-9219-aef3913bda6f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:09.847169 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-35559437-3a64-4d85-9219-aef3913bda6f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Going to try to terminate instance {{(pid=124674) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:41:10.002931 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b75ad942-7578-4d71-9017-855f7d4f93a0 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.227327 May 25 07:41:10.003536 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 297/576] 10.222.0.24 () {60 vars in 1158 bytes} [Wed May 25 07:41:09 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:41:10.392900 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-35559437-3a64-4d85-9219-aef3913bda6f tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "DELETE /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 204 len: 0 microversion: 2.1 time: 0.582923 May 25 07:41:10.393679 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 280/577] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:41:09 2022] DELETE /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 0 bytes in 584 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 07:41:10.402664 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-1539395c-c8c0-4ca3-8d69-12e7801153c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:10.407331 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-1539395c-c8c0-4ca3-8d69-12e7801153c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:10.410599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1539395c-c8c0-4ca3-8d69-12e7801153c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:10.411099 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1539395c-c8c0-4ca3-8d69-12e7801153c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:10.411881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1539395c-c8c0-4ca3-8d69-12e7801153c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:10.412328 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1539395c-c8c0-4ca3-8d69-12e7801153c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:10.548084 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-1539395c-c8c0-4ca3-8d69-12e7801153c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:10.556896 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-1539395c-c8c0-4ca3-8d69-12e7801153c6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1518 microversion: 2.1 time: 0.158288 May 25 07:41:10.557472 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 298/578] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:10 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1518 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:11.575868 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-89242c44-a4ab-4b9e-b825-668ff6724fb6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:11.576701 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-89242c44-a4ab-4b9e-b825-668ff6724fb6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:11.596541 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-89242c44-a4ab-4b9e-b825-668ff6724fb6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:11.597008 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-89242c44-a4ab-4b9e-b825-668ff6724fb6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:11.597794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-89242c44-a4ab-4b9e-b825-668ff6724fb6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:11.598236 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-89242c44-a4ab-4b9e-b825-668ff6724fb6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:11.762733 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-89242c44-a4ab-4b9e-b825-668ff6724fb6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:11.770334 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-89242c44-a4ab-4b9e-b825-668ff6724fb6 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1518 microversion: 2.1 time: 0.198770 May 25 07:41:11.770900 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 281/579] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:11 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1518 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:41:12.598883 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ad825969-fa83-4110-a82d-9747abda7cea tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1393517104", "imageRef": "ddc5b622-a846-425a-b8fd-7e5caef00bf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f85a9936-18a2-497c-90b9-ba6df25b9b6e"}], "security_groups": [{"name": "tempest-securitygroup--1602926344"}], "key_name": "tempest-keypair-1409151964", "user_data": "}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:41:12.701691 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.network.neutron [None req-ad825969-fa83-4110-a82d-9747abda7cea tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] validate_networks() for [('f85a9936-18a2-497c-90b9-ba6df25b9b6e', None, None, None, None, None)] {{(pid=124675) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:41:12.787095 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-a5330de6-d47d-4ba0-8b6d-f38dbba44a35 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:12.787818 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-a5330de6-d47d-4ba0-8b6d-f38dbba44a35 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:12.795147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a5330de6-d47d-4ba0-8b6d-f38dbba44a35 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:12.795600 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a5330de6-d47d-4ba0-8b6d-f38dbba44a35 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:12.796373 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a5330de6-d47d-4ba0-8b6d-f38dbba44a35 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:12.796845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a5330de6-d47d-4ba0-8b6d-f38dbba44a35 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:12.936431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a5330de6-d47d-4ba0-8b6d-f38dbba44a35 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:12.938872 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:12.945387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-a5330de6-d47d-4ba0-8b6d-f38dbba44a35 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1518 microversion: 2.1 time: 0.161429 May 25 07:41:12.946016 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 282/580] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:12 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1518 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:13.068336 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-ad825969-fa83-4110-a82d-9747abda7cea tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Flavor limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:41:13.068848 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-ad825969-fa83-4110-a82d-9747abda7cea tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Image limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:41:13.069414 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-ad825969-fa83-4110-a82d-9747abda7cea tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Flavor pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:41:13.070527 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-ad825969-fa83-4110-a82d-9747abda7cea tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Image pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:41:13.070948 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-ad825969-fa83-4110-a82d-9747abda7cea tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:41:13.079870 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ad825969-fa83-4110-a82d-9747abda7cea tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:13.087410 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ad825969-fa83-4110-a82d-9747abda7cea tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:13.087410 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ad825969-fa83-4110-a82d-9747abda7cea tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:13.087410 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ad825969-fa83-4110-a82d-9747abda7cea tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:13.098739 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-ad825969-fa83-4110-a82d-9747abda7cea tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Getting quotas for project 294afe2c36184564a80fb6bef7b32359. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:41:13.102868 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-ad825969-fa83-4110-a82d-9747abda7cea tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Getting quotas for user 28d83ef95cda448dbd72acbd13a5f008 and project 294afe2c36184564a80fb6bef7b32359. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:41:13.113847 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ad825969-fa83-4110-a82d-9747abda7cea tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Going to run 1 instances... {{(pid=124675) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:41:13.116109 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ad825969-fa83-4110-a82d-9747abda7cea tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddc5b622-a846-425a-b8fd-7e5caef00bf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:41:13.257895 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ad825969-fa83-4110-a82d-9747abda7cea tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.663028 May 25 07:41:13.258901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 299/581] 10.222.0.24 () {60 vars in 1146 bytes} [Wed May 25 07:41:12 2022] POST /compute/v2.1/servers => generated 402 bytes in 665 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 07:41:13.269173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-a50461c3-f469-47c8-af95-cf1f7415b1de tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:13.269900 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-a50461c3-f469-47c8-af95-cf1f7415b1de tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:13.323989 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a50461c3-f469-47c8-af95-cf1f7415b1de tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:13.331392 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-a50461c3-f469-47c8-af95-cf1f7415b1de tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 200 len: 1238 microversion: 2.1 time: 0.066573 May 25 07:41:13.331967 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 283/582] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:13 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 1238 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:13.963018 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8df5f3c3-8b1e-4966-a8fc-3ce8fe74f032 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:13.963638 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-8df5f3c3-8b1e-4966-a8fc-3ce8fe74f032 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:13.965939 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:13.970828 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8df5f3c3-8b1e-4966-a8fc-3ce8fe74f032 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:13.971314 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8df5f3c3-8b1e-4966-a8fc-3ce8fe74f032 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:13.972222 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8df5f3c3-8b1e-4966-a8fc-3ce8fe74f032 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:13.972701 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8df5f3c3-8b1e-4966-a8fc-3ce8fe74f032 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:14.106265 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-8df5f3c3-8b1e-4966-a8fc-3ce8fe74f032 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:14.114102 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-8df5f3c3-8b1e-4966-a8fc-3ce8fe74f032 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1518 microversion: 2.1 time: 0.155783 May 25 07:41:14.114671 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 300/583] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:13 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1518 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:14.345148 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-e29e3256-39d4-4574-ad42-6f915f42771e req-00983017-c8c1-4b17-b85e-ce9e350efcbe service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2d5a90d7-311f-4e4a-84c2-ff14c0440bd2", "name": "network-vif-deleted", "tag": "37369604-0009-4591-97a8-6e3c90d97049"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:41:14.349097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b1b9ef68-a25d-4a8b-8d62-4dc79b423613 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:14.349719 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b1b9ef68-a25d-4a8b-8d62-4dc79b423613 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:14.356733 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-e29e3256-39d4-4574-ad42-6f915f42771e req-00983017-c8c1-4b17-b85e-ce9e350efcbe service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:14.357260 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-e29e3256-39d4-4574-ad42-6f915f42771e req-00983017-c8c1-4b17-b85e-ce9e350efcbe service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:14.357362 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b1b9ef68-a25d-4a8b-8d62-4dc79b423613 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:14.357791 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b1b9ef68-a25d-4a8b-8d62-4dc79b423613 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:14.358562 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b1b9ef68-a25d-4a8b-8d62-4dc79b423613 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:14.359002 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b1b9ef68-a25d-4a8b-8d62-4dc79b423613 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:14.368277 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-e29e3256-39d4-4574-ad42-6f915f42771e req-00983017-c8c1-4b17-b85e-ce9e350efcbe service nova] Creating event network-vif-deleted:37369604-0009-4591-97a8-6e3c90d97049 for instance 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 on hv-cinder-82549 May 25 07:41:14.373410 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-e29e3256-39d4-4574-ad42-6f915f42771e req-00983017-c8c1-4b17-b85e-ce9e350efcbe service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032976 May 25 07:41:14.374084 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 284/584] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:41:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:41:14.422086 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b1b9ef68-a25d-4a8b-8d62-4dc79b423613 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:14.429731 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b1b9ef68-a25d-4a8b-8d62-4dc79b423613 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 200 len: 1242 microversion: 2.1 time: 0.084665 May 25 07:41:14.432271 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 301/585] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:14 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 1242 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:41:15.131522 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-a485db09-f534-4d8f-91ac-90d755ae0fc4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:15.133314 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-a485db09-f534-4d8f-91ac-90d755ae0fc4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:15.139239 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a485db09-f534-4d8f-91ac-90d755ae0fc4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:15.139694 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a485db09-f534-4d8f-91ac-90d755ae0fc4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:15.140466 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a485db09-f534-4d8f-91ac-90d755ae0fc4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:15.140936 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a485db09-f534-4d8f-91ac-90d755ae0fc4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:15.171777 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a485db09-f534-4d8f-91ac-90d755ae0fc4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:15.172231 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a485db09-f534-4d8f-91ac-90d755ae0fc4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:15.172729 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.objects.instance [None req-a485db09-f534-4d8f-91ac-90d755ae0fc4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lazy-loading 'fault' on Instance uuid 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 {{(pid=124674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:41:15.218265 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a485db09-f534-4d8f-91ac-90d755ae0fc4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f90f0f6afda54e80bc319dc5bdb80ea6', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4719a4804e24f27b9427e58c5cbe13b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:15.225710 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-a485db09-f534-4d8f-91ac-90d755ae0fc4 tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 200 len: 1311 microversion: 2.1 time: 0.098412 May 25 07:41:15.226815 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 285/586] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:15 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:15.364654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-6ac31d06-1e9d-4c24-8fe6-881e06fef005 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:15.365178 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-6ac31d06-1e9d-4c24-8fe6-881e06fef005 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:15.372309 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6ac31d06-1e9d-4c24-8fe6-881e06fef005 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:15.372792 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6ac31d06-1e9d-4c24-8fe6-881e06fef005 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:15.373556 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6ac31d06-1e9d-4c24-8fe6-881e06fef005 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:15.373995 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6ac31d06-1e9d-4c24-8fe6-881e06fef005 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:15.396612 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-6ac31d06-1e9d-4c24-8fe6-881e06fef005 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58/ips" status: 200 len: 150 microversion: 2.1 time: 0.036869 May 25 07:41:15.397269 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 302/587] 10.222.0.24 () {58 vars in 1247 bytes} [Wed May 25 07:41:15 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58/ips => generated 150 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:41:15.450260 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-2830f556-f47f-4beb-93aa-6ee1e8e423c5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:15.451856 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-2830f556-f47f-4beb-93aa-6ee1e8e423c5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:15.462737 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2830f556-f47f-4beb-93aa-6ee1e8e423c5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:15.463543 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2830f556-f47f-4beb-93aa-6ee1e8e423c5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:15.464561 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2830f556-f47f-4beb-93aa-6ee1e8e423c5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:15.465187 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2830f556-f47f-4beb-93aa-6ee1e8e423c5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:15.537985 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-2830f556-f47f-4beb-93aa-6ee1e8e423c5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:15.546127 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-2830f556-f47f-4beb-93aa-6ee1e8e423c5 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 200 len: 1290 microversion: 2.1 time: 0.102532 May 25 07:41:15.546776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 286/588] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:15 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 1290 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:16.243536 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-c5b18aec-153c-4e4d-8faa-0871d007376c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:16.244193 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-c5b18aec-153c-4e4d-8faa-0871d007376c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] [instance: 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:16.250795 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c5b18aec-153c-4e4d-8faa-0871d007376c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:16.254878 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c5b18aec-153c-4e4d-8faa-0871d007376c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:16.254878 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c5b18aec-153c-4e4d-8faa-0871d007376c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:16.254878 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c5b18aec-153c-4e4d-8faa-0871d007376c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:16.266193 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-c5b18aec-153c-4e4d-8faa-0871d007376c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] HTTP exception thrown: Instance 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 could not be found. May 25 07:41:16.267965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-c5b18aec-153c-4e4d-8faa-0871d007376c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Request method failure captured: May 25 07:41:16.267965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 HTTP/1.1 May 25 07:41:16.267965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:41:16.267965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:41:16.267965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:41:16.267965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:41:16.267965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:41:16.267965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:41:16.267965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:41:16.267965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:41:16.267965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijdyGuqDe3p06hkpp6ohyIkCZkEMZD-Xm9k8dFGeecHnJxdqekCaABg8wzmfOAlxn-W8UpasXr7XYWqwQfoR7IZRkPp3JQjBoqqqadXk1ODtfCJewTnu7WrLyB1br2CZbFtQzX_dfu8qpnIIdjcBpxB5N_NNozK67UOqIu_ddo6FZg-U May 25 07:41:16.267965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:41:16.267965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:41:16.267965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:41:16.267965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:41:16.267965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:41:16.267965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:41:16.267965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: d4719a4804e24f27b9427e58c5cbe13b May 25 07:41:16.267965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-274124411 May 25 07:41:16.267965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:41:16.267965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:41:16.269298 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d4719a4804e24f27b9427e58c5cbe13b"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/d4719a4804e24f27b9427e58c5cbe13b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_d4719a4804e24f27b9427e58c5cbe13b", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/d4719a4804e24f27b9427e58c5cbe13b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:41:16.269298 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-ServerRescueNegativeTestJSON-274124411 May 25 07:41:16.269298 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: d4719a4804e24f27b9427e58c5cbe13b May 25 07:41:16.269298 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-274124411 May 25 07:41:16.269298 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-ServerRescueNegativeTestJSON-274124411-project May 25 07:41:16.269298 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:41:16.269298 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:41:16.269298 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: f90f0f6afda54e80bc319dc5bdb80ea6 May 25 07:41:16.269298 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-ServerRescueNegativeTestJSON-274124411-project May 25 07:41:16.269298 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:41:16.269298 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 could not be found. May 25 07:41:16.269298 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': '2d5a90d7-311f-4e4a-84c2-ff14c0440bd2'} May 25 07:41:16.270044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:41:16.270044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:41:16.270044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:41:16.270044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:41:16.270044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:41:16.270044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:41:16.270044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:41:16.270044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:41:16.270044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:41:16.270044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:41:16.270044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 could not be found. May 25 07:41:16.270044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:41:16.270044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:41:16.270044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:41:16.270044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:41:16.270044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:41:16.270044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:41:16.270044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:41:16.270044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:41:16.270044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:41:16.271211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:41:16.271211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:41:16.271211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:41:16.271211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:41:16.271211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:41:16.271211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:41:16.271211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:41:16.271211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 could not be found. May 25 07:41:16.271211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:41:16.271211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:41:16.271211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:41:16.271211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:41:16.271211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:41:16.271211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:41:16.271211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:41:16.271211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:41:16.271211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 could not be found. May 25 07:41:16.271211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:41:16.272278 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-c5b18aec-153c-4e4d-8faa-0871d007376c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] Returning 404 to user: Instance 2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:41:16.272278 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-c5b18aec-153c-4e4d-8faa-0871d007376c tempest-ServerRescueNegativeTestJSON-274124411 tempest-ServerRescueNegativeTestJSON-274124411-project] 10.222.0.24 "GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2" status: 404 len: 111 microversion: 2.1 time: 0.030815 May 25 07:41:16.273684 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 303/589] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:16 2022] GET /compute/v2.1/servers/2d5a90d7-311f-4e4a-84c2-ff14c0440bd2 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:41:16.564646 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-435381e5-6c88-4e50-8a05-b5366ac1d125 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:16.565265 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-435381e5-6c88-4e50-8a05-b5366ac1d125 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:16.572423 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-435381e5-6c88-4e50-8a05-b5366ac1d125 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:16.572958 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-435381e5-6c88-4e50-8a05-b5366ac1d125 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:16.573745 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-435381e5-6c88-4e50-8a05-b5366ac1d125 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:16.574186 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-435381e5-6c88-4e50-8a05-b5366ac1d125 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:16.801430 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-435381e5-6c88-4e50-8a05-b5366ac1d125 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:16.809828 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-435381e5-6c88-4e50-8a05-b5366ac1d125 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 200 len: 1364 microversion: 2.1 time: 0.249250 May 25 07:41:16.810403 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 287/590] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:16 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 1364 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:17.152390 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-fe92de29-cc35-4785-9b99-7bdf3be36f4d tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ba78347-9630-43d8-9a60-0166ecc77341"}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:41:17.154186 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-fe92de29-cc35-4785-9b99-7bdf3be36f4d tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:17.161107 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fe92de29-cc35-4785-9b99-7bdf3be36f4d tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:17.161624 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fe92de29-cc35-4785-9b99-7bdf3be36f4d tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:17.162404 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fe92de29-cc35-4785-9b99-7bdf3be36f4d tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:17.162845 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fe92de29-cc35-4785-9b99-7bdf3be36f4d tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:17.828858 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-b70d6b49-8e67-447c-895c-b920b96b15c7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:17.829449 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-b70d6b49-8e67-447c-895c-b920b96b15c7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:17.837794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b70d6b49-8e67-447c-895c-b920b96b15c7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:17.838486 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b70d6b49-8e67-447c-895c-b920b96b15c7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:17.839527 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b70d6b49-8e67-447c-895c-b920b96b15c7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:17.840120 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b70d6b49-8e67-447c-895c-b920b96b15c7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:18.029622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-b70d6b49-8e67-447c-895c-b920b96b15c7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:18.047106 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-b70d6b49-8e67-447c-895c-b920b96b15c7 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 200 len: 1364 microversion: 2.1 time: 0.222273 May 25 07:41:18.047805 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 288/591] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:17 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:41:18.054213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-4e62c69e-8db1-42db-83fd-7a2b424edf66 req-45166d7d-aa8a-4fca-b055-071e6eb1e5c0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c5136fd-d373-4990-9a64-52d7549c48fa", "tag": "82e28fc3-f3d3-49bd-a344-d2f7bb0dbf27"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:41:18.058163 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-fe92de29-cc35-4785-9b99-7bdf3be36f4d tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "POST /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.909698 May 25 07:41:18.060781 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 304/592] 10.222.0.24 () {60 vars in 1322 bytes} [Wed May 25 07:41:17 2022] POST /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58/os-volume_attachments => generated 194 bytes in 913 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:41:18.065707 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-4e62c69e-8db1-42db-83fd-7a2b424edf66 req-45166d7d-aa8a-4fca-b055-071e6eb1e5c0 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:18.067285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-4e62c69e-8db1-42db-83fd-7a2b424edf66 req-45166d7d-aa8a-4fca-b055-071e6eb1e5c0 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:18.080580 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-4e62c69e-8db1-42db-83fd-7a2b424edf66 req-45166d7d-aa8a-4fca-b055-071e6eb1e5c0 service nova] Creating event network-changed:82e28fc3-f3d3-49bd-a344-d2f7bb0dbf27 for instance 2c5136fd-d373-4990-9a64-52d7549c48fa on hv-cinder-82549 May 25 07:41:18.089287 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-4e62c69e-8db1-42db-83fd-7a2b424edf66 req-45166d7d-aa8a-4fca-b055-071e6eb1e5c0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039692 May 25 07:41:18.099794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 289/593] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:41:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:41:19.065965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-62d2a572-a7ad-4d6e-9bf9-3a1168c37317 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:19.066584 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-62d2a572-a7ad-4d6e-9bf9-3a1168c37317 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:19.073311 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-62d2a572-a7ad-4d6e-9bf9-3a1168c37317 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:19.073800 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-62d2a572-a7ad-4d6e-9bf9-3a1168c37317 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:19.074574 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-62d2a572-a7ad-4d6e-9bf9-3a1168c37317 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:19.075055 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-62d2a572-a7ad-4d6e-9bf9-3a1168c37317 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:19.241178 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-62d2a572-a7ad-4d6e-9bf9-3a1168c37317 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:19.252293 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-62d2a572-a7ad-4d6e-9bf9-3a1168c37317 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 200 len: 1364 microversion: 2.1 time: 0.191306 May 25 07:41:19.253076 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 305/594] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:19 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 1364 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:20.270054 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-74f1af6b-5976-49e4-ba2a-693c335becbf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:20.272820 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-74f1af6b-5976-49e4-ba2a-693c335becbf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:20.281564 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-74f1af6b-5976-49e4-ba2a-693c335becbf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:20.282549 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-74f1af6b-5976-49e4-ba2a-693c335becbf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:20.283548 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-74f1af6b-5976-49e4-ba2a-693c335becbf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:20.284271 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-74f1af6b-5976-49e4-ba2a-693c335becbf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:20.434893 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-74f1af6b-5976-49e4-ba2a-693c335becbf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:20.442810 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-74f1af6b-5976-49e4-ba2a-693c335becbf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 200 len: 1364 microversion: 2.1 time: 0.177000 May 25 07:41:20.448136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 290/595] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:20 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:21.461132 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-d8728066-f737-42d3-a47e-d6bfedc256bf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:21.461765 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-d8728066-f737-42d3-a47e-d6bfedc256bf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:21.468304 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d8728066-f737-42d3-a47e-d6bfedc256bf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:21.468804 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d8728066-f737-42d3-a47e-d6bfedc256bf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:21.469583 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d8728066-f737-42d3-a47e-d6bfedc256bf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:21.470034 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d8728066-f737-42d3-a47e-d6bfedc256bf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:21.474134 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:21.603080 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d8728066-f737-42d3-a47e-d6bfedc256bf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:21.610626 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-d8728066-f737-42d3-a47e-d6bfedc256bf tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 200 len: 1364 microversion: 2.1 time: 0.153848 May 25 07:41:21.611505 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 306/596] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:21 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:22.628046 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-401eb6dc-feaa-43fb-9fdd-42d3aa08c052 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:22.628620 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-401eb6dc-feaa-43fb-9fdd-42d3aa08c052 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:22.636173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-401eb6dc-feaa-43fb-9fdd-42d3aa08c052 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:22.636670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-401eb6dc-feaa-43fb-9fdd-42d3aa08c052 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:22.637448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-401eb6dc-feaa-43fb-9fdd-42d3aa08c052 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:22.637894 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-401eb6dc-feaa-43fb-9fdd-42d3aa08c052 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:22.771916 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-401eb6dc-feaa-43fb-9fdd-42d3aa08c052 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:22.780526 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-401eb6dc-feaa-43fb-9fdd-42d3aa08c052 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 200 len: 1364 microversion: 2.1 time: 0.156098 May 25 07:41:22.781116 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 291/597] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:22 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:23.798329 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-d60367bc-00a8-415b-be2d-1c91ffc63b04 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:23.798954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-d60367bc-00a8-415b-be2d-1c91ffc63b04 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:23.801676 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=2 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:23.802326 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=10 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:23.808183 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d60367bc-00a8-415b-be2d-1c91ffc63b04 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:23.808678 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d60367bc-00a8-415b-be2d-1c91ffc63b04 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:23.809458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d60367bc-00a8-415b-be2d-1c91ffc63b04 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:23.809901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d60367bc-00a8-415b-be2d-1c91ffc63b04 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:23.950435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d60367bc-00a8-415b-be2d-1c91ffc63b04 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:23.958045 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-d60367bc-00a8-415b-be2d-1c91ffc63b04 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 200 len: 1364 microversion: 2.1 time: 0.163569 May 25 07:41:23.958774 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 307/598] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:23 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:24.981266 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d786759b-3fe4-443b-ba56-1c32b8b2ca5b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:24.982458 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d786759b-3fe4-443b-ba56-1c32b8b2ca5b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:24.984703 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=2 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:24.985844 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=78,nova_api:UPDATE=2 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:24.990826 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d786759b-3fe4-443b-ba56-1c32b8b2ca5b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:24.992082 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d786759b-3fe4-443b-ba56-1c32b8b2ca5b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:24.992992 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d786759b-3fe4-443b-ba56-1c32b8b2ca5b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:24.993435 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d786759b-3fe4-443b-ba56-1c32b8b2ca5b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:25.012383 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-103e5bc4-3ef3-4fed-9281-6ed99461079e req-0199a855-eb3c-4e80-b011-75c95d9b4de0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5136fd-d373-4990-9a64-52d7549c48fa", "name": "network-vif-plugged", "status": "completed", "tag": "82e28fc3-f3d3-49bd-a344-d2f7bb0dbf27"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:41:25.027782 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-103e5bc4-3ef3-4fed-9281-6ed99461079e req-0199a855-eb3c-4e80-b011-75c95d9b4de0 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:25.028471 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-103e5bc4-3ef3-4fed-9281-6ed99461079e req-0199a855-eb3c-4e80-b011-75c95d9b4de0 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:25.041782 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-103e5bc4-3ef3-4fed-9281-6ed99461079e req-0199a855-eb3c-4e80-b011-75c95d9b4de0 service nova] Creating event network-vif-plugged:82e28fc3-f3d3-49bd-a344-d2f7bb0dbf27 for instance 2c5136fd-d373-4990-9a64-52d7549c48fa on hv-cinder-82549 May 25 07:41:25.046918 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-103e5bc4-3ef3-4fed-9281-6ed99461079e req-0199a855-eb3c-4e80-b011-75c95d9b4de0 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040288 May 25 07:41:25.047528 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 308/599] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:41:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:41:25.133108 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d786759b-3fe4-443b-ba56-1c32b8b2ca5b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:25.140938 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d786759b-3fe4-443b-ba56-1c32b8b2ca5b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 200 len: 1364 microversion: 2.1 time: 0.167550 May 25 07:41:25.141513 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 292/600] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:24 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:26.158801 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a28c2973-b4d2-4440-a373-a9196dec6118 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:26.159504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a28c2973-b4d2-4440-a373-a9196dec6118 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:26.166076 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a28c2973-b4d2-4440-a373-a9196dec6118 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:26.166490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a28c2973-b4d2-4440-a373-a9196dec6118 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:26.167300 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a28c2973-b4d2-4440-a373-a9196dec6118 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:26.175874 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a28c2973-b4d2-4440-a373-a9196dec6118 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:26.305965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a28c2973-b4d2-4440-a373-a9196dec6118 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:26.313593 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a28c2973-b4d2-4440-a373-a9196dec6118 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 200 len: 1364 microversion: 2.1 time: 0.159424 May 25 07:41:26.314151 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 309/601] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:26 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:26.711461 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-e6f441f6-df1f-447e-8a30-9bc35a26e220 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1ba78347-9630-43d8-9a60-0166ecc77341"}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:41:26.712576 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-e6f441f6-df1f-447e-8a30-9bc35a26e220 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:26.720216 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e6f441f6-df1f-447e-8a30-9bc35a26e220 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:26.720697 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e6f441f6-df1f-447e-8a30-9bc35a26e220 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:26.721469 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e6f441f6-df1f-447e-8a30-9bc35a26e220 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:26.721902 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e6f441f6-df1f-447e-8a30-9bc35a26e220 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:26.806009 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-e6f441f6-df1f-447e-8a30-9bc35a26e220 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] HTTP exception thrown: Invalid volume: volume 1ba78347-9630-43d8-9a60-0166ecc77341 is already attached to instances: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 May 25 07:41:26.807714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-e6f441f6-df1f-447e-8a30-9bc35a26e220 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Request method failure captured: May 25 07:41:26.807714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: POST /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58/os-volume_attachments HTTP/1.1 May 25 07:41:26.807714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:41:26.807714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:41:26.807714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:41:26.807714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 74 May 25 07:41:26.807714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:41:26.807714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:41:26.807714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:41:26.807714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:41:26.807714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdyI17YkjQqKsTicl5BdlTZvAyQ_GMXlLJBh83Og-ZMS2KVi2Us0aJRqbM6uLQgUDMPeORhcs3ta8E3UdJWMvBXVjTqxdi2zYK0EmeD76I0JveUsx0Rz9WMLKSIeeZZQrA5vc_1CQNMm1pSzCady0n-o4b9yXkMaGi83bIjdMzlEcds May 25 07:41:26.807714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:41:26.807714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:41:26.807714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:41:26.807714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:41:26.807714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:41:26.807714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:41:26.807714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:41:26.807714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:41:26.807714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:41:26.807714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:41:26.812304 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2d8e35800ce043acbcb027ce406ed2e7", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:41:26.812304 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:41:26.812304 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:41:26.812304 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:41:26.812304 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:41:26.812304 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:41:26.812304 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:41:26.812304 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: 0487ea9076ee4baf8138fdc25ce02522 May 25 07:41:26.812304 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:41:26.812304 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: May 25 07:41:26.812304 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {"volumeAttachment": {"volumeId": "1ba78347-9630-43d8-9a60-0166ecc77341"}} May 25 07:41:26.812304 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:41:26.813797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Invalid volume: volume 1ba78347-9630-43d8-9a60-0166ecc77341 is already attached to instances: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 May 25 07:41:26.813797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'server_id': '43b6c572-c0f9-46e4-bd01-0cc1583cfe58', 'body': {'volumeAttachment': {'volumeId': '1ba78347-9630-43d8-9a60-0166ecc77341'}}} May 25 07:41:26.813797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:41:26.813797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:41:26.813797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create May 25 07:41:26.813797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( May 25 07:41:26.813797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner May 25 07:41:26.813797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) May 25 07:41:26.813797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner May 25 07:41:26.813797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) May 25 07:41:26.813797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume May 25 07:41:26.813797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) May 25 07:41:26.813797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached May 25 07:41:26.813797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) May 25 07:41:26.813797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 1ba78347-9630-43d8-9a60-0166ecc77341 is already attached to instances: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 May 25 07:41:26.813797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:41:26.813797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:41:26.813797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:41:26.813797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:41:26.815841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:41:26.815841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:41:26.815841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:41:26.815841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:41:26.815841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:41:26.815841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:41:26.815841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 07:41:26.815841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 07:41:26.815841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 07:41:26.815841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 07:41:26.815841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper May 25 07:41:26.815841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) May 25 07:41:26.815841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create May 25 07:41:26.815841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) May 25 07:41:26.815841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 1ba78347-9630-43d8-9a60-0166ecc77341 is already attached to instances: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 May 25 07:41:26.815841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:41:26.815841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:41:26.815841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:41:26.815841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:41:26.815841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:41:26.818395 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:41:26.818395 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:41:26.818395 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:41:26.818395 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 1ba78347-9630-43d8-9a60-0166ecc77341 is already attached to instances: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 May 25 07:41:26.818395 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:41:26.818395 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-e6f441f6-df1f-447e-8a30-9bc35a26e220 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Returning 400 to user: Invalid volume: volume 1ba78347-9630-43d8-9a60-0166ecc77341 is already attached to instances: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:41:26.818395 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-e6f441f6-df1f-447e-8a30-9bc35a26e220 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "POST /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101831 May 25 07:41:26.818395 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 293/602] 10.222.0.24 () {60 vars in 1322 bytes} [Wed May 25 07:41:26 2022] POST /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) May 25 07:41:26.871951 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-e9bd686f-3bca-486d-be0c-d902876d8b6e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:26.872446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-e9bd686f-3bca-486d-be0c-d902876d8b6e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:26.878560 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e9bd686f-3bca-486d-be0c-d902876d8b6e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:26.879017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e9bd686f-3bca-486d-be0c-d902876d8b6e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:26.879777 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e9bd686f-3bca-486d-be0c-d902876d8b6e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:26.880214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e9bd686f-3bca-486d-be0c-d902876d8b6e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:26.968294 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.objects.instance [None req-e9bd686f-3bca-486d-be0c-d902876d8b6e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lazy-loading 'services' on Instance uuid 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 {{(pid=124675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:41:27.261964 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-e9bd686f-3bca-486d-be0c-d902876d8b6e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "DELETE /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58/os-volume_attachments/1ba78347-9630-43d8-9a60-0166ecc77341" status: 202 len: 0 microversion: 2.1 time: 0.393611 May 25 07:41:27.262974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 310/603] 10.222.0.24 () {58 vars in 1415 bytes} [Wed May 25 07:41:26 2022] DELETE /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58/os-volume_attachments/1ba78347-9630-43d8-9a60-0166ecc77341 => generated 0 bytes in 395 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:41:27.271529 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d8fe45cc-6f22-4a2e-8f51-7d0d66351d60 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:27.272457 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d8fe45cc-6f22-4a2e-8f51-7d0d66351d60 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:27.280865 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d8fe45cc-6f22-4a2e-8f51-7d0d66351d60 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:27.281321 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d8fe45cc-6f22-4a2e-8f51-7d0d66351d60 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:27.284262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d8fe45cc-6f22-4a2e-8f51-7d0d66351d60 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:27.284262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d8fe45cc-6f22-4a2e-8f51-7d0d66351d60 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:27.312154 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d8fe45cc-6f22-4a2e-8f51-7d0d66351d60 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045144 May 25 07:41:27.313052 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 294/604] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:41:27 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:41:27.331799 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b53ae5b1-ef63-445c-afd1-997f87b8e3c2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:27.332667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b53ae5b1-ef63-445c-afd1-997f87b8e3c2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:27.341410 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b53ae5b1-ef63-445c-afd1-997f87b8e3c2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:27.341946 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b53ae5b1-ef63-445c-afd1-997f87b8e3c2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:27.347485 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b53ae5b1-ef63-445c-afd1-997f87b8e3c2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:27.347485 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b53ae5b1-ef63-445c-afd1-997f87b8e3c2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:27.489368 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b53ae5b1-ef63-445c-afd1-997f87b8e3c2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:27.501197 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b53ae5b1-ef63-445c-afd1-997f87b8e3c2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 200 len: 1364 microversion: 2.1 time: 0.173724 May 25 07:41:27.501881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 311/605] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:27 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:28.324409 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-6df887b5-eb56-40a0-8bbb-29727c0f8971 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:28.325285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-6df887b5-eb56-40a0-8bbb-29727c0f8971 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:28.331492 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6df887b5-eb56-40a0-8bbb-29727c0f8971 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:28.331934 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6df887b5-eb56-40a0-8bbb-29727c0f8971 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:28.332732 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6df887b5-eb56-40a0-8bbb-29727c0f8971 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:28.333168 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6df887b5-eb56-40a0-8bbb-29727c0f8971 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:28.362871 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-6df887b5-eb56-40a0-8bbb-29727c0f8971 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043534 May 25 07:41:28.363424 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 295/606] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:41:28 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:41:28.518624 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4c902b95-4b1a-43ea-93c9-e0839845bbff tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:28.519312 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4c902b95-4b1a-43ea-93c9-e0839845bbff tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:28.527285 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4c902b95-4b1a-43ea-93c9-e0839845bbff tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:28.527739 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4c902b95-4b1a-43ea-93c9-e0839845bbff tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:28.528626 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4c902b95-4b1a-43ea-93c9-e0839845bbff tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:28.529068 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4c902b95-4b1a-43ea-93c9-e0839845bbff tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:28.873560 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4c902b95-4b1a-43ea-93c9-e0839845bbff tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:28.881350 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4c902b95-4b1a-43ea-93c9-e0839845bbff tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 200 len: 1549 microversion: 2.1 time: 0.366663 May 25 07:41:28.881922 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 312/607] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:28 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 1549 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:28.907009 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-183bf54a-bb52-4812-bd13-39c0c4c36ec2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:28.907614 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-183bf54a-bb52-4812-bd13-39c0c4c36ec2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:28.914115 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-183bf54a-bb52-4812-bd13-39c0c4c36ec2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:28.914430 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-183bf54a-bb52-4812-bd13-39c0c4c36ec2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:28.915147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-183bf54a-bb52-4812-bd13-39c0c4c36ec2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:28.915586 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-183bf54a-bb52-4812-bd13-39c0c4c36ec2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:29.054861 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-183bf54a-bb52-4812-bd13-39c0c4c36ec2 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151136 May 25 07:41:29.055728 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 296/608] 10.222.0.24 () {58 vars in 1274 bytes} [Wed May 25 07:41:28 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:41:29.374412 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-660111db-20aa-4a73-a59b-45915984e50f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:29.375392 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-660111db-20aa-4a73-a59b-45915984e50f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:29.381946 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-660111db-20aa-4a73-a59b-45915984e50f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:29.382457 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-660111db-20aa-4a73-a59b-45915984e50f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:29.383688 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-660111db-20aa-4a73-a59b-45915984e50f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:29.384128 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-660111db-20aa-4a73-a59b-45915984e50f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:29.417545 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-660111db-20aa-4a73-a59b-45915984e50f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047206 May 25 07:41:29.418140 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 313/609] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:41:29 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 07:41:29.479372 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-4c92c1e9-577b-4e4f-944d-56a2f13d0a55 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:29.479828 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-4c92c1e9-577b-4e4f-944d-56a2f13d0a55 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:29.486680 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4c92c1e9-577b-4e4f-944d-56a2f13d0a55 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:29.487125 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4c92c1e9-577b-4e4f-944d-56a2f13d0a55 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:29.488089 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4c92c1e9-577b-4e4f-944d-56a2f13d0a55 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:29.488740 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4c92c1e9-577b-4e4f-944d-56a2f13d0a55 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:29.514681 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-4c92c1e9-577b-4e4f-944d-56a2f13d0a55 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Going to try to terminate instance {{(pid=124674) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:41:29.871936 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-4c92c1e9-577b-4e4f-944d-56a2f13d0a55 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "DELETE /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 204 len: 0 microversion: 2.1 time: 0.395663 May 25 07:41:29.872260 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 297/610] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:41:29 2022] DELETE /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 07:41:29.880896 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-77a3d8b6-adc6-4a7c-a3c5-e6d950e625a4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:29.881607 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-77a3d8b6-adc6-4a7c-a3c5-e6d950e625a4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:29.890679 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-77a3d8b6-adc6-4a7c-a3c5-e6d950e625a4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:29.891434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-77a3d8b6-adc6-4a7c-a3c5-e6d950e625a4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:29.892708 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-77a3d8b6-adc6-4a7c-a3c5-e6d950e625a4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:29.893118 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-77a3d8b6-adc6-4a7c-a3c5-e6d950e625a4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:30.034304 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-77a3d8b6-adc6-4a7c-a3c5-e6d950e625a4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:30.042137 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-77a3d8b6-adc6-4a7c-a3c5-e6d950e625a4 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 200 len: 1682 microversion: 2.1 time: 0.165567 May 25 07:41:30.042706 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 314/611] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:29 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 1682 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:30.339551 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-2cd90735-546c-4b65-b2ff-608e7082fe51 req-ed433295-231e-479e-be04-de6aee18d92c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2c5136fd-d373-4990-9a64-52d7549c48fa", "tag": "82e28fc3-f3d3-49bd-a344-d2f7bb0dbf27"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:41:30.349690 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-2cd90735-546c-4b65-b2ff-608e7082fe51 req-ed433295-231e-479e-be04-de6aee18d92c service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:30.349690 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-2cd90735-546c-4b65-b2ff-608e7082fe51 req-ed433295-231e-479e-be04-de6aee18d92c service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:30.360858 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-2cd90735-546c-4b65-b2ff-608e7082fe51 req-ed433295-231e-479e-be04-de6aee18d92c service nova] Creating event network-changed:82e28fc3-f3d3-49bd-a344-d2f7bb0dbf27 for instance 2c5136fd-d373-4990-9a64-52d7549c48fa on hv-cinder-82549 May 25 07:41:30.366263 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-2cd90735-546c-4b65-b2ff-608e7082fe51 req-ed433295-231e-479e-be04-de6aee18d92c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030700 May 25 07:41:30.367727 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 298/612] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:41:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:41:31.059301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-135f950d-2851-475a-97b3-d592394fb878 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:31.059921 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-135f950d-2851-475a-97b3-d592394fb878 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:31.066403 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-135f950d-2851-475a-97b3-d592394fb878 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:31.066859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-135f950d-2851-475a-97b3-d592394fb878 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:31.067629 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-135f950d-2851-475a-97b3-d592394fb878 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:31.068140 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-135f950d-2851-475a-97b3-d592394fb878 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:31.215586 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-135f950d-2851-475a-97b3-d592394fb878 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:31.223907 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-135f950d-2851-475a-97b3-d592394fb878 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 200 len: 1682 microversion: 2.1 time: 0.168434 May 25 07:41:31.224519 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 315/613] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:31 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 1682 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:32.242869 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-a4b4ca48-a579-46c8-b234-5e335580a06a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:32.243961 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-a4b4ca48-a579-46c8-b234-5e335580a06a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:32.249951 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a4b4ca48-a579-46c8-b234-5e335580a06a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:32.250397 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a4b4ca48-a579-46c8-b234-5e335580a06a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:32.251168 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a4b4ca48-a579-46c8-b234-5e335580a06a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:32.251601 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a4b4ca48-a579-46c8-b234-5e335580a06a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:32.458133 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a4b4ca48-a579-46c8-b234-5e335580a06a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:32.466679 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-a4b4ca48-a579-46c8-b234-5e335580a06a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 200 len: 1682 microversion: 2.1 time: 0.228746 May 25 07:41:32.467253 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 299/614] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:32 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 1682 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:32.843048 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-40cc9223-044b-453f-a85a-d05ccc96e747 req-d0c87135-9b2c-4e33-85c0-13f4ec82c7d4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "43b6c572-c0f9-46e4-bd01-0cc1583cfe58", "name": "network-vif-deleted", "tag": "627e7547-a34e-487f-a611-64aa7bd85302"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:41:32.851364 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-40cc9223-044b-453f-a85a-d05ccc96e747 req-d0c87135-9b2c-4e33-85c0-13f4ec82c7d4 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:32.851971 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-40cc9223-044b-453f-a85a-d05ccc96e747 req-d0c87135-9b2c-4e33-85c0-13f4ec82c7d4 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:32.863092 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-40cc9223-044b-453f-a85a-d05ccc96e747 req-d0c87135-9b2c-4e33-85c0-13f4ec82c7d4 service nova] Creating event network-vif-deleted:627e7547-a34e-487f-a611-64aa7bd85302 for instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 on hv-cinder-82549 May 25 07:41:32.868444 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-40cc9223-044b-453f-a85a-d05ccc96e747 req-d0c87135-9b2c-4e33-85c0-13f4ec82c7d4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029619 May 25 07:41:32.869065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 316/615] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:41:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:41:33.483426 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7d79eac8-d177-4cbd-8220-246aaa8d3d7b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:33.484050 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-7d79eac8-d177-4cbd-8220-246aaa8d3d7b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:33.491221 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7d79eac8-d177-4cbd-8220-246aaa8d3d7b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:33.492293 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7d79eac8-d177-4cbd-8220-246aaa8d3d7b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:33.493127 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7d79eac8-d177-4cbd-8220-246aaa8d3d7b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:33.493569 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7d79eac8-d177-4cbd-8220-246aaa8d3d7b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:33.526458 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7d79eac8-d177-4cbd-8220-246aaa8d3d7b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:33.526915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7d79eac8-d177-4cbd-8220-246aaa8d3d7b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:33.527378 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.objects.instance [None req-7d79eac8-d177-4cbd-8220-246aaa8d3d7b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lazy-loading 'fault' on Instance uuid 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 {{(pid=124674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:41:33.529337 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:33.577723 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7d79eac8-d177-4cbd-8220-246aaa8d3d7b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:33.579858 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-7d79eac8-d177-4cbd-8220-246aaa8d3d7b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 200 len: 1332 microversion: 2.1 time: 0.100450 May 25 07:41:33.580420 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 300/616] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:33 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 1332 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:34.598631 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8a260036-da38-4333-88f6-14621788dd31 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:34.599341 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-8a260036-da38-4333-88f6-14621788dd31 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:34.605518 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8a260036-da38-4333-88f6-14621788dd31 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:34.605972 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8a260036-da38-4333-88f6-14621788dd31 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:34.606772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8a260036-da38-4333-88f6-14621788dd31 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:34.607212 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8a260036-da38-4333-88f6-14621788dd31 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:34.621335 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-8a260036-da38-4333-88f6-14621788dd31 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] HTTP exception thrown: Instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 could not be found. May 25 07:41:34.622974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8a260036-da38-4333-88f6-14621788dd31 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Request method failure captured: May 25 07:41:34.622974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 HTTP/1.1 May 25 07:41:34.622974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:41:34.622974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:41:34.622974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:41:34.622974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:41:34.622974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:41:34.622974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:41:34.622974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:41:34.622974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:41:34.622974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijdyI17YkjQqKsTicl5BdlTZvAyQ_GMXlLJBh83Og-ZMS2KVi2Us0aJRqbM6uLQgUDMPeORhcs3ta8E3UdJWMvBXVjTqxdi2zYK0EmeD76I0JveUsx0Rz9WMLKSIeeZZQrA5vc_1CQNMm1pSzCady0n-o4b9yXkMaGi83bIjdMzlEcds May 25 07:41:34.622974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:41:34.622974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:41:34.622974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:41:34.622974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:41:34.622974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:41:34.622974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:41:34.622974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:41:34.622974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:41:34.622974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:41:34.622974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:41:34.624542 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2d8e35800ce043acbcb027ce406ed2e7", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:41:34.624542 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:41:34.624542 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:41:34.624542 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:41:34.624542 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:41:34.624542 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:41:34.624542 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:41:34.624542 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: 0487ea9076ee4baf8138fdc25ce02522 May 25 07:41:34.624542 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:41:34.624542 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:41:34.624542 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 could not be found. May 25 07:41:34.624542 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': '43b6c572-c0f9-46e4-bd01-0cc1583cfe58'} May 25 07:41:34.625523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:41:34.625523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:41:34.625523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:41:34.625523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:41:34.625523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:41:34.625523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:41:34.625523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:41:34.625523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:41:34.625523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:41:34.625523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:41:34.625523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 could not be found. May 25 07:41:34.625523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:41:34.625523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:41:34.625523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:41:34.625523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:41:34.625523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:41:34.625523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:41:34.625523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:41:34.625523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:41:34.625523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:41:34.627051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:41:34.627051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:41:34.627051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:41:34.627051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:41:34.627051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:41:34.627051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:41:34.627051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:41:34.627051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 could not be found. May 25 07:41:34.627051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:41:34.627051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:41:34.627051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:41:34.627051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:41:34.627051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:41:34.627051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:41:34.627051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:41:34.627051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:41:34.627051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 could not be found. May 25 07:41:34.627051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:41:34.635123 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8a260036-da38-4333-88f6-14621788dd31 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Returning 404 to user: Instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:41:34.635123 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-8a260036-da38-4333-88f6-14621788dd31 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 404 len: 111 microversion: 2.1 time: 0.030659 May 25 07:41:34.635123 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 317/617] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:34 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:41:34.635477 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-8926d285-06aa-4455-ade3-92c2702e0498 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '.version_select at 0x7fc8641f9790>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:34.755757 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-8926d285-06aa-4455-ade3-92c2702e0498 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865389899" status: 202 len: 0 microversion: 2.1 time: 0.125904 May 25 07:41:34.756390 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 301/618] 10.222.0.24 () {58 vars in 1220 bytes} [Wed May 25 07:41:34 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1865389899 => generated 0 bytes in 127 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:41:35.577369 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-e188c74a-b26f-45af-a4ee-60d59bce4881 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Action: 'create', calling method: .version_select at 0x7fc86419ce50>, body: {"keypair": {"name": "tempest-keypair-717019098", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNGtzuWVlpslOwWt27Du0TSDuMXbzbHfYj2MjJ3mj4cECkR3DypDYH2CpeSZ5wiAAZcuEh1GoEwGvdC/V5iOO1v6W+T6Z9z0dbgtZZUtHmSIb0aqrN6XY/BDkU1xHI/Iag=="}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:41:35.592302 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-e188c74a-b26f-45af-a4ee-60d59bce4881 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Getting quotas for project 2d8e35800ce043acbcb027ce406ed2e7. Resources: {'key_pairs'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:41:35.597321 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-e188c74a-b26f-45af-a4ee-60d59bce4881 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Getting quotas for user 0487ea9076ee4baf8138fdc25ce02522 and project 2d8e35800ce043acbcb027ce406ed2e7. Resources: {'key_pairs'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:41:35.705754 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-e188c74a-b26f-45af-a4ee-60d59bce4881 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.132230 May 25 07:41:35.706415 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 318/619] 10.222.0.24 () {60 vars in 1158 bytes} [Wed May 25 07:41:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:41:38.082084 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-fb855ed5-c926-46ca-b91d-756e280ba242 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1762317050", "imageRef": "ddc5b622-a846-425a-b8fd-7e5caef00bf8", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f39d85d3-0173-4496-879c-2b83e234d364"}], "security_groups": [{"name": "tempest-securitygroup--735915060"}], "key_name": "tempest-keypair-717019098", "user_data": "}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:41:38.195401 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.network.neutron [None req-fb855ed5-c926-46ca-b91d-756e280ba242 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] validate_networks() for [('f39d85d3-0173-4496-879c-2b83e234d364', None, None, None, None, None)] {{(pid=124674) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:41:38.389266 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-110f157b-cfea-4cf0-8dfa-030c8c247c37 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:38.390753 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-110f157b-cfea-4cf0-8dfa-030c8c247c37 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:38.399533 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-110f157b-cfea-4cf0-8dfa-030c8c247c37 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:38.400072 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-110f157b-cfea-4cf0-8dfa-030c8c247c37 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:38.400980 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-110f157b-cfea-4cf0-8dfa-030c8c247c37 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:38.401622 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-110f157b-cfea-4cf0-8dfa-030c8c247c37 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:38.431307 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-110f157b-cfea-4cf0-8dfa-030c8c247c37 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41/ips" status: 200 len: 152 microversion: 2.20 time: 0.053728 May 25 07:41:38.432171 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 319/620] 10.222.0.24 () {60 vars in 1288 bytes} [Wed May 25 07:41:38 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41/ips => generated 152 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) May 25 07:41:38.948645 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-fb855ed5-c926-46ca-b91d-756e280ba242 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Flavor limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:41:38.949076 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-fb855ed5-c926-46ca-b91d-756e280ba242 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Image limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:41:38.953251 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-fb855ed5-c926-46ca-b91d-756e280ba242 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Flavor pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:41:38.953251 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-fb855ed5-c926-46ca-b91d-756e280ba242 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Image pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:41:38.953251 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-fb855ed5-c926-46ca-b91d-756e280ba242 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:41:38.959880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fb855ed5-c926-46ca-b91d-756e280ba242 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:38.960975 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fb855ed5-c926-46ca-b91d-756e280ba242 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:38.961783 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fb855ed5-c926-46ca-b91d-756e280ba242 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:38.962220 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fb855ed5-c926-46ca-b91d-756e280ba242 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:38.980930 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-fb855ed5-c926-46ca-b91d-756e280ba242 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Getting quotas for project 2d8e35800ce043acbcb027ce406ed2e7. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:41:38.985516 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-fb855ed5-c926-46ca-b91d-756e280ba242 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Getting quotas for user 0487ea9076ee4baf8138fdc25ce02522 and project 2d8e35800ce043acbcb027ce406ed2e7. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:41:38.997337 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-fb855ed5-c926-46ca-b91d-756e280ba242 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Going to run 1 instances... {{(pid=124674) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:41:38.999647 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-fb855ed5-c926-46ca-b91d-756e280ba242 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddc5b622-a846-425a-b8fd-7e5caef00bf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:41:39.176176 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-fb855ed5-c926-46ca-b91d-756e280ba242 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.100276 May 25 07:41:39.177179 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 302/621] 10.222.0.24 () {60 vars in 1146 bytes} [Wed May 25 07:41:38 2022] POST /compute/v2.1/servers => generated 401 bytes in 1102 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 07:41:39.187518 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-6c361377-62f6-417c-908d-920c9d49675a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:39.188243 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-6c361377-62f6-417c-908d-920c9d49675a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:39.249405 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-6c361377-62f6-417c-908d-920c9d49675a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:39.258542 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-6c361377-62f6-417c-908d-920c9d49675a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1241 microversion: 2.1 time: 0.075051 May 25 07:41:39.259311 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 320/622] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:39 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1241 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:40.287523 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-0770ce79-0470-44ea-8b54-38b448c52bdb tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:40.287523 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-0770ce79-0470-44ea-8b54-38b448c52bdb tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:40.287523 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0770ce79-0470-44ea-8b54-38b448c52bdb tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:40.287523 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0770ce79-0470-44ea-8b54-38b448c52bdb tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:40.288776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0770ce79-0470-44ea-8b54-38b448c52bdb tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:40.288776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0770ce79-0470-44ea-8b54-38b448c52bdb tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:40.348766 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-0770ce79-0470-44ea-8b54-38b448c52bdb tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:40.356501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-0770ce79-0470-44ea-8b54-38b448c52bdb tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1245 microversion: 2.1 time: 0.084690 May 25 07:41:40.357074 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 303/623] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:40 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1245 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:40.747771 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-65bcc877-3d89-46b7-bbe7-ae983e5f4957 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:41:40.748367 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-65bcc877-3d89-46b7-bbe7-ae983e5f4957 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:40.754967 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-65bcc877-3d89-46b7-bbe7-ae983e5f4957 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:40.755481 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-65bcc877-3d89-46b7-bbe7-ae983e5f4957 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:40.756667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-65bcc877-3d89-46b7-bbe7-ae983e5f4957 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:40.757119 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-65bcc877-3d89-46b7-bbe7-ae983e5f4957 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:40.780727 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.objects.instance [None req-65bcc877-3d89-46b7-bbe7-ae983e5f4957 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lazy-loading 'flavor' on Instance uuid c0ecec15-f302-4eea-92e6-37049703fa41 {{(pid=124675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:41:41.338803 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-65bcc877-3d89-46b7-bbe7-ae983e5f4957 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "POST /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41/action" status: 202 len: 0 microversion: 2.20 time: 0.595060 May 25 07:41:41.339360 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 321/624] 10.222.0.24 () {62 vars in 1318 bytes} [Wed May 25 07:41:40 2022] POST /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41/action => generated 0 bytes in 597 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 07:41:41.347554 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-400e5295-4a11-4ad9-8bd0-5971aae9d428 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:41.348165 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-400e5295-4a11-4ad9-8bd0-5971aae9d428 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:41.354799 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-400e5295-4a11-4ad9-8bd0-5971aae9d428 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:41.355247 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-400e5295-4a11-4ad9-8bd0-5971aae9d428 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:41.356039 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-400e5295-4a11-4ad9-8bd0-5971aae9d428 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:41.356501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-400e5295-4a11-4ad9-8bd0-5971aae9d428 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:41.490348 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-400e5295-4a11-4ad9-8bd0-5971aae9d428 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:41.499438 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-13fbf57d-0e0b-463c-9a3c-94631e895acd tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:41.500153 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-13fbf57d-0e0b-463c-9a3c-94631e895acd tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:41.503008 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-400e5295-4a11-4ad9-8bd0-5971aae9d428 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:41.504745 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-400e5295-4a11-4ad9-8bd0-5971aae9d428 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:41.506095 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-400e5295-4a11-4ad9-8bd0-5971aae9d428 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1724 microversion: 2.20 time: 0.162457 May 25 07:41:41.506459 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-13fbf57d-0e0b-463c-9a3c-94631e895acd tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:41.506650 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 304/625] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:41:41 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:41:41.506912 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-13fbf57d-0e0b-463c-9a3c-94631e895acd tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:41.507687 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-13fbf57d-0e0b-463c-9a3c-94631e895acd tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:41.508127 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-13fbf57d-0e0b-463c-9a3c-94631e895acd tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:41.572975 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-13fbf57d-0e0b-463c-9a3c-94631e895acd tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:41.580440 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-13fbf57d-0e0b-463c-9a3c-94631e895acd tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1245 microversion: 2.1 time: 0.208676 May 25 07:41:41.581043 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 322/626] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:41 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1245 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:41:42.524902 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-11a52564-080f-42e0-955f-fc0d412e098e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:42.525504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-11a52564-080f-42e0-955f-fc0d412e098e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:42.532042 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-11a52564-080f-42e0-955f-fc0d412e098e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:42.533410 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-11a52564-080f-42e0-955f-fc0d412e098e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:42.533410 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-11a52564-080f-42e0-955f-fc0d412e098e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:42.533707 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-11a52564-080f-42e0-955f-fc0d412e098e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:42.597564 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-1db568c1-9e79-4dae-85b3-2a9b11266c46 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:42.598176 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-1db568c1-9e79-4dae-85b3-2a9b11266c46 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:42.604644 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1db568c1-9e79-4dae-85b3-2a9b11266c46 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:42.605100 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1db568c1-9e79-4dae-85b3-2a9b11266c46 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:42.605870 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1db568c1-9e79-4dae-85b3-2a9b11266c46 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:42.606305 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1db568c1-9e79-4dae-85b3-2a9b11266c46 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:42.667662 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-11a52564-080f-42e0-955f-fc0d412e098e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:42.667860 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-1db568c1-9e79-4dae-85b3-2a9b11266c46 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:42.676067 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-11a52564-080f-42e0-955f-fc0d412e098e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:42.676823 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-1db568c1-9e79-4dae-85b3-2a9b11266c46 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1245 microversion: 2.1 time: 0.082757 May 25 07:41:42.677138 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 323/627] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:42 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:41:42.677614 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-11a52564-080f-42e0-955f-fc0d412e098e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:42.678859 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-11a52564-080f-42e0-955f-fc0d412e098e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1724 microversion: 2.20 time: 0.158047 May 25 07:41:42.679410 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 305/628] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:41:42 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:41:43.694248 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-f9ed6a38-c710-4af6-8987-75a95877c9c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:43.694865 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-f9ed6a38-c710-4af6-8987-75a95877c9c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:43.698556 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-9b5e6165-fe30-4a6f-b907-73765b39e4b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:43.699749 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-9b5e6165-fe30-4a6f-b907-73765b39e4b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:43.702260 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f9ed6a38-c710-4af6-8987-75a95877c9c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:43.703528 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f9ed6a38-c710-4af6-8987-75a95877c9c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:43.703528 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f9ed6a38-c710-4af6-8987-75a95877c9c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:43.704072 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f9ed6a38-c710-4af6-8987-75a95877c9c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:43.706241 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9b5e6165-fe30-4a6f-b907-73765b39e4b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:43.706685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9b5e6165-fe30-4a6f-b907-73765b39e4b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:43.707453 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9b5e6165-fe30-4a6f-b907-73765b39e4b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:43.707905 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9b5e6165-fe30-4a6f-b907-73765b39e4b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:43.720184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:43.771734 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-f9ed6a38-c710-4af6-8987-75a95877c9c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:43.781856 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-f9ed6a38-c710-4af6-8987-75a95877c9c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1237 microversion: 2.1 time: 0.091723 May 25 07:41:43.789068 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 324/629] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:43 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1237 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:43.840832 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9b5e6165-fe30-4a6f-b907-73765b39e4b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:43.848896 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9b5e6165-fe30-4a6f-b907-73765b39e4b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:43.850417 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9b5e6165-fe30-4a6f-b907-73765b39e4b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:43.851554 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-9b5e6165-fe30-4a6f-b907-73765b39e4b0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1724 microversion: 2.20 time: 0.157568 May 25 07:41:43.852111 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 306/630] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:41:43 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:41:44.799470 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-89392ff4-46d2-4835-ae0c-29dea95c6db1 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:44.800082 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-89392ff4-46d2-4835-ae0c-29dea95c6db1 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:44.807122 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-89392ff4-46d2-4835-ae0c-29dea95c6db1 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:44.807566 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-89392ff4-46d2-4835-ae0c-29dea95c6db1 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:44.808329 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-89392ff4-46d2-4835-ae0c-29dea95c6db1 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:44.808789 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-89392ff4-46d2-4835-ae0c-29dea95c6db1 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:44.870896 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-9bc90fc9-e2a3-40e2-9319-4bfb69cdfe63 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:44.871672 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-9bc90fc9-e2a3-40e2-9319-4bfb69cdfe63 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:44.880126 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-89392ff4-46d2-4835-ae0c-29dea95c6db1 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:44.881662 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9bc90fc9-e2a3-40e2-9319-4bfb69cdfe63 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:44.882197 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9bc90fc9-e2a3-40e2-9319-4bfb69cdfe63 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:44.883476 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9bc90fc9-e2a3-40e2-9319-4bfb69cdfe63 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:44.884180 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9bc90fc9-e2a3-40e2-9319-4bfb69cdfe63 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:44.893795 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-89392ff4-46d2-4835-ae0c-29dea95c6db1 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1311 microversion: 2.1 time: 0.098425 May 25 07:41:44.905535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 325/631] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:44 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1311 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:45.112042 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9bc90fc9-e2a3-40e2-9319-4bfb69cdfe63 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:45.120420 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9bc90fc9-e2a3-40e2-9319-4bfb69cdfe63 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:45.122001 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9bc90fc9-e2a3-40e2-9319-4bfb69cdfe63 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:45.123160 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-9bc90fc9-e2a3-40e2-9319-4bfb69cdfe63 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1724 microversion: 2.20 time: 0.257006 May 25 07:41:45.123720 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 307/632] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:41:44 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1724 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:41:45.913362 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-0c36cab2-b269-4a0a-88cb-567bc0ef1d24 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:45.913930 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-0c36cab2-b269-4a0a-88cb-567bc0ef1d24 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:45.921135 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0c36cab2-b269-4a0a-88cb-567bc0ef1d24 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:45.921593 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0c36cab2-b269-4a0a-88cb-567bc0ef1d24 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:45.922361 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0c36cab2-b269-4a0a-88cb-567bc0ef1d24 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:45.922808 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0c36cab2-b269-4a0a-88cb-567bc0ef1d24 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:46.050521 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-0c36cab2-b269-4a0a-88cb-567bc0ef1d24 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:46.059199 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-0c36cab2-b269-4a0a-88cb-567bc0ef1d24 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1366 microversion: 2.1 time: 0.149761 May 25 07:41:46.063122 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 326/633] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:45 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:46.141857 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-2b3a08a3-6972-494d-9b68-069f1183d1f3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:46.142459 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-2b3a08a3-6972-494d-9b68-069f1183d1f3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:46.148886 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2b3a08a3-6972-494d-9b68-069f1183d1f3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:46.149412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2b3a08a3-6972-494d-9b68-069f1183d1f3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:46.150363 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2b3a08a3-6972-494d-9b68-069f1183d1f3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:46.150799 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2b3a08a3-6972-494d-9b68-069f1183d1f3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:46.277695 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-2b3a08a3-6972-494d-9b68-069f1183d1f3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:46.285637 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-2b3a08a3-6972-494d-9b68-069f1183d1f3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:46.287161 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-2b3a08a3-6972-494d-9b68-069f1183d1f3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:46.288314 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-2b3a08a3-6972-494d-9b68-069f1183d1f3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1724 microversion: 2.20 time: 0.150335 May 25 07:41:46.288904 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 308/634] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:41:46 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1724 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:41:47.078946 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-890259e2-454b-4546-9af2-4d236a772987 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:47.079475 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-890259e2-454b-4546-9af2-4d236a772987 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:47.086212 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-890259e2-454b-4546-9af2-4d236a772987 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:47.086677 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-890259e2-454b-4546-9af2-4d236a772987 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:47.087952 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-890259e2-454b-4546-9af2-4d236a772987 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:47.088407 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-890259e2-454b-4546-9af2-4d236a772987 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:47.221062 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-890259e2-454b-4546-9af2-4d236a772987 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:47.228485 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-890259e2-454b-4546-9af2-4d236a772987 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1366 microversion: 2.1 time: 0.153648 May 25 07:41:47.229059 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 327/635] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:47 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:47.406768 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-2230e735-f8f8-482e-b3c3-f7ef87b331a8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:47.407380 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-2230e735-f8f8-482e-b3c3-f7ef87b331a8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:47.413249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2230e735-f8f8-482e-b3c3-f7ef87b331a8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:47.413691 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2230e735-f8f8-482e-b3c3-f7ef87b331a8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:47.414447 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2230e735-f8f8-482e-b3c3-f7ef87b331a8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:47.415611 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2230e735-f8f8-482e-b3c3-f7ef87b331a8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:47.545433 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-2230e735-f8f8-482e-b3c3-f7ef87b331a8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:47.553485 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-2230e735-f8f8-482e-b3c3-f7ef87b331a8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:47.555013 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-2230e735-f8f8-482e-b3c3-f7ef87b331a8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:47.556886 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-2230e735-f8f8-482e-b3c3-f7ef87b331a8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1724 microversion: 2.20 time: 0.254477 May 25 07:41:47.557447 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 309/636] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:41:47 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1724 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:41:48.246688 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-28e91e2d-f389-42e0-99eb-e80a889066c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:48.247317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-28e91e2d-f389-42e0-99eb-e80a889066c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:48.249781 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=67,nova_api:INSERT=1 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:48.254685 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-28e91e2d-f389-42e0-99eb-e80a889066c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:48.255145 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-28e91e2d-f389-42e0-99eb-e80a889066c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:48.255919 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-28e91e2d-f389-42e0-99eb-e80a889066c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:48.256362 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-28e91e2d-f389-42e0-99eb-e80a889066c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:48.389805 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-28e91e2d-f389-42e0-99eb-e80a889066c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:48.402591 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-28e91e2d-f389-42e0-99eb-e80a889066c8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1366 microversion: 2.1 time: 0.160740 May 25 07:41:48.408064 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 328/637] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:48 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:48.575314 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d638d9b8-44a4-46ed-a23f-6a2811379964 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:48.579707 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d638d9b8-44a4-46ed-a23f-6a2811379964 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:48.588612 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d638d9b8-44a4-46ed-a23f-6a2811379964 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:48.589589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d638d9b8-44a4-46ed-a23f-6a2811379964 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:48.590383 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d638d9b8-44a4-46ed-a23f-6a2811379964 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:48.590827 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d638d9b8-44a4-46ed-a23f-6a2811379964 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:48.764253 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-f6bba6c2-b976-4edb-a3df-b6fec0edbf94 req-8a6517a2-9eed-41b3-8d30-2ae3b9a10f40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1792da3-df94-4a97-9f39-a2200abfad07", "tag": "3879946e-3068-47dd-b88c-190f047d242d"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:41:48.771573 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d638d9b8-44a4-46ed-a23f-6a2811379964 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:48.771992 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-f6bba6c2-b976-4edb-a3df-b6fec0edbf94 req-8a6517a2-9eed-41b3-8d30-2ae3b9a10f40 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:48.772451 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-f6bba6c2-b976-4edb-a3df-b6fec0edbf94 req-8a6517a2-9eed-41b3-8d30-2ae3b9a10f40 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:48.781432 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d638d9b8-44a4-46ed-a23f-6a2811379964 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:48.787277 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d638d9b8-44a4-46ed-a23f-6a2811379964 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:48.787277 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d638d9b8-44a4-46ed-a23f-6a2811379964 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1724 microversion: 2.20 time: 0.215155 May 25 07:41:48.795526 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 310/638] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:41:48 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:41:48.795989 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-f6bba6c2-b976-4edb-a3df-b6fec0edbf94 req-8a6517a2-9eed-41b3-8d30-2ae3b9a10f40 service nova] Creating event network-changed:3879946e-3068-47dd-b88c-190f047d242d for instance e1792da3-df94-4a97-9f39-a2200abfad07 on hv-cinder-82549 May 25 07:41:48.800928 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-f6bba6c2-b976-4edb-a3df-b6fec0edbf94 req-8a6517a2-9eed-41b3-8d30-2ae3b9a10f40 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042621 May 25 07:41:48.801991 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 329/639] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:41:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:41:49.422451 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-a8970fc5-fabc-43a2-a68d-276499bc5840 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:49.423069 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-a8970fc5-fabc-43a2-a68d-276499bc5840 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:49.425060 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=2 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:49.425861 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=6 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:49.431348 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a8970fc5-fabc-43a2-a68d-276499bc5840 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:49.431744 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a8970fc5-fabc-43a2-a68d-276499bc5840 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:49.432552 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a8970fc5-fabc-43a2-a68d-276499bc5840 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:49.432997 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a8970fc5-fabc-43a2-a68d-276499bc5840 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:49.642061 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a8970fc5-fabc-43a2-a68d-276499bc5840 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:49.649790 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-a8970fc5-fabc-43a2-a68d-276499bc5840 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1366 microversion: 2.1 time: 0.231560 May 25 07:41:49.650364 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 311/640] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:49 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1366 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:41:49.803907 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=6 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:49.809018 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ea082ed1-64fe-4173-9ffb-b424bc694be5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:49.809711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ea082ed1-64fe-4173-9ffb-b424bc694be5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:49.815780 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ea082ed1-64fe-4173-9ffb-b424bc694be5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:49.816227 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ea082ed1-64fe-4173-9ffb-b424bc694be5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:49.817023 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ea082ed1-64fe-4173-9ffb-b424bc694be5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:49.817485 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ea082ed1-64fe-4173-9ffb-b424bc694be5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:49.945726 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ea082ed1-64fe-4173-9ffb-b424bc694be5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:49.954129 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ea082ed1-64fe-4173-9ffb-b424bc694be5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:49.955657 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ea082ed1-64fe-4173-9ffb-b424bc694be5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:49.960665 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ea082ed1-64fe-4173-9ffb-b424bc694be5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1724 microversion: 2.20 time: 0.154419 May 25 07:41:49.960665 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 330/641] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:41:49 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:41:50.666856 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-9809504a-1c0b-456e-9c6c-cfae572c21e2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:50.667477 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-9809504a-1c0b-456e-9c6c-cfae572c21e2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:50.673950 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9809504a-1c0b-456e-9c6c-cfae572c21e2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:50.674344 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9809504a-1c0b-456e-9c6c-cfae572c21e2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:50.675111 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9809504a-1c0b-456e-9c6c-cfae572c21e2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:50.675551 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9809504a-1c0b-456e-9c6c-cfae572c21e2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:50.804660 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9809504a-1c0b-456e-9c6c-cfae572c21e2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:50.813151 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-9809504a-1c0b-456e-9c6c-cfae572c21e2 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1366 microversion: 2.1 time: 0.150222 May 25 07:41:50.813823 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 312/642] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:50 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:50.974638 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-18affe2b-8ebd-4217-80e2-01bfcfacfd97 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:50.975239 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-18affe2b-8ebd-4217-80e2-01bfcfacfd97 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:50.984247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-18affe2b-8ebd-4217-80e2-01bfcfacfd97 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:50.984739 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-18affe2b-8ebd-4217-80e2-01bfcfacfd97 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:50.985655 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-18affe2b-8ebd-4217-80e2-01bfcfacfd97 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:50.986203 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-18affe2b-8ebd-4217-80e2-01bfcfacfd97 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:51.121640 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-18affe2b-8ebd-4217-80e2-01bfcfacfd97 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:51.129549 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-18affe2b-8ebd-4217-80e2-01bfcfacfd97 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:51.131062 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-18affe2b-8ebd-4217-80e2-01bfcfacfd97 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:51.132250 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-18affe2b-8ebd-4217-80e2-01bfcfacfd97 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1724 microversion: 2.20 time: 0.161860 May 25 07:41:51.132824 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 331/643] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:41:50 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:41:51.830948 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-51bcb364-a797-42d3-888a-2327e3988d21 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:51.831553 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-51bcb364-a797-42d3-888a-2327e3988d21 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:51.837982 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-51bcb364-a797-42d3-888a-2327e3988d21 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:51.838426 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-51bcb364-a797-42d3-888a-2327e3988d21 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:51.839180 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-51bcb364-a797-42d3-888a-2327e3988d21 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:51.839615 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-51bcb364-a797-42d3-888a-2327e3988d21 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:51.963442 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-51bcb364-a797-42d3-888a-2327e3988d21 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:51.970778 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-51bcb364-a797-42d3-888a-2327e3988d21 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1366 microversion: 2.1 time: 0.143671 May 25 07:41:51.971340 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 313/644] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:51 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1366 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:52.149781 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-67a58651-cbae-494a-bd14-71eabff44839 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:52.150496 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-67a58651-cbae-494a-bd14-71eabff44839 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:52.158584 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-67a58651-cbae-494a-bd14-71eabff44839 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:52.159043 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-67a58651-cbae-494a-bd14-71eabff44839 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:52.159813 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-67a58651-cbae-494a-bd14-71eabff44839 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:52.160256 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-67a58651-cbae-494a-bd14-71eabff44839 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:52.289864 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-67a58651-cbae-494a-bd14-71eabff44839 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:52.298410 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-67a58651-cbae-494a-bd14-71eabff44839 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:52.299929 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-67a58651-cbae-494a-bd14-71eabff44839 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:52.301116 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-67a58651-cbae-494a-bd14-71eabff44839 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1724 microversion: 2.20 time: 0.155298 May 25 07:41:52.301679 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 332/645] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:41:52 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:41:52.988436 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-66bd337d-95fc-4cd1-8801-d80d1cc0f6a9 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:52.989071 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-66bd337d-95fc-4cd1-8801-d80d1cc0f6a9 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:52.996338 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-66bd337d-95fc-4cd1-8801-d80d1cc0f6a9 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:52.996849 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-66bd337d-95fc-4cd1-8801-d80d1cc0f6a9 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:52.997665 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-66bd337d-95fc-4cd1-8801-d80d1cc0f6a9 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:52.998105 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-66bd337d-95fc-4cd1-8801-d80d1cc0f6a9 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:53.133555 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-66bd337d-95fc-4cd1-8801-d80d1cc0f6a9 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:53.141770 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-66bd337d-95fc-4cd1-8801-d80d1cc0f6a9 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1366 microversion: 2.1 time: 0.157455 May 25 07:41:53.142347 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 314/646] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:52 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:53.319436 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-cd41f77f-730d-47ae-afbe-ac8e9a9942c0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:53.319975 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-cd41f77f-730d-47ae-afbe-ac8e9a9942c0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:53.327218 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cd41f77f-730d-47ae-afbe-ac8e9a9942c0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:53.327703 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cd41f77f-730d-47ae-afbe-ac8e9a9942c0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:53.328471 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cd41f77f-730d-47ae-afbe-ac8e9a9942c0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:53.328936 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cd41f77f-730d-47ae-afbe-ac8e9a9942c0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:53.458496 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-cd41f77f-730d-47ae-afbe-ac8e9a9942c0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:53.466925 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-cd41f77f-730d-47ae-afbe-ac8e9a9942c0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:53.468441 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-cd41f77f-730d-47ae-afbe-ac8e9a9942c0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:53.469633 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-cd41f77f-730d-47ae-afbe-ac8e9a9942c0 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1724 microversion: 2.20 time: 0.154249 May 25 07:41:53.470219 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 333/647] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:41:53 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:41:54.158846 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-167c26b8-b42d-4da7-bfc4-efea323cef8a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:54.159461 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-167c26b8-b42d-4da7-bfc4-efea323cef8a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:54.166422 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-167c26b8-b42d-4da7-bfc4-efea323cef8a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:54.167047 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-167c26b8-b42d-4da7-bfc4-efea323cef8a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:54.167822 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-167c26b8-b42d-4da7-bfc4-efea323cef8a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:54.168261 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-167c26b8-b42d-4da7-bfc4-efea323cef8a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:54.300173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-167c26b8-b42d-4da7-bfc4-efea323cef8a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:54.309804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-167c26b8-b42d-4da7-bfc4-efea323cef8a tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1366 microversion: 2.1 time: 0.154748 May 25 07:41:54.310450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 315/648] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:54 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:54.487937 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8882518f-abd8-4609-8c4d-f7c692e97b70 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:54.488468 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-8882518f-abd8-4609-8c4d-f7c692e97b70 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:54.495538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8882518f-abd8-4609-8c4d-f7c692e97b70 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:54.495994 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8882518f-abd8-4609-8c4d-f7c692e97b70 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:54.496822 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8882518f-abd8-4609-8c4d-f7c692e97b70 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:54.497260 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8882518f-abd8-4609-8c4d-f7c692e97b70 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:54.624376 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-8882518f-abd8-4609-8c4d-f7c692e97b70 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:54.632421 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-8882518f-abd8-4609-8c4d-f7c692e97b70 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:54.634168 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-8882518f-abd8-4609-8c4d-f7c692e97b70 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:54.636194 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-8882518f-abd8-4609-8c4d-f7c692e97b70 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1724 microversion: 2.20 time: 0.152483 May 25 07:41:54.636826 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 334/649] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:41:54 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:41:55.327810 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-91632ae3-8993-4192-aca4-c12f4bf63b36 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:55.328422 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-91632ae3-8993-4192-aca4-c12f4bf63b36 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:55.335029 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-91632ae3-8993-4192-aca4-c12f4bf63b36 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:55.335480 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-91632ae3-8993-4192-aca4-c12f4bf63b36 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:55.336249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-91632ae3-8993-4192-aca4-c12f4bf63b36 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:55.336711 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-91632ae3-8993-4192-aca4-c12f4bf63b36 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:55.469806 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-91632ae3-8993-4192-aca4-c12f4bf63b36 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:55.477852 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-91632ae3-8993-4192-aca4-c12f4bf63b36 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1366 microversion: 2.1 time: 0.154001 May 25 07:41:55.479819 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 316/650] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:55 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:55.542213 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-9bab9cb0-8ead-4b11-b7f4-1229d950da21 req-0a65b433-4b93-4ff6-baef-4fe9247fdf38 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1792da3-df94-4a97-9f39-a2200abfad07", "name": "network-vif-plugged", "status": "completed", "tag": "3879946e-3068-47dd-b88c-190f047d242d"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:41:55.550949 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-9bab9cb0-8ead-4b11-b7f4-1229d950da21 req-0a65b433-4b93-4ff6-baef-4fe9247fdf38 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:55.551211 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-9bab9cb0-8ead-4b11-b7f4-1229d950da21 req-0a65b433-4b93-4ff6-baef-4fe9247fdf38 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:55.562837 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-9bab9cb0-8ead-4b11-b7f4-1229d950da21 req-0a65b433-4b93-4ff6-baef-4fe9247fdf38 service nova] Creating event network-vif-plugged:3879946e-3068-47dd-b88c-190f047d242d for instance e1792da3-df94-4a97-9f39-a2200abfad07 on hv-cinder-82549 May 25 07:41:55.567709 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-9bab9cb0-8ead-4b11-b7f4-1229d950da21 req-0a65b433-4b93-4ff6-baef-4fe9247fdf38 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029249 May 25 07:41:55.568494 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 335/651] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:41:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:41:55.655267 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-0803adf4-81a4-4e64-be5e-5bfbd09e7fbe tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:55.655924 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-0803adf4-81a4-4e64-be5e-5bfbd09e7fbe tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:55.662383 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0803adf4-81a4-4e64-be5e-5bfbd09e7fbe tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:55.663079 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0803adf4-81a4-4e64-be5e-5bfbd09e7fbe tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:55.663864 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0803adf4-81a4-4e64-be5e-5bfbd09e7fbe tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:55.664302 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0803adf4-81a4-4e64-be5e-5bfbd09e7fbe tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:55.803240 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-0803adf4-81a4-4e64-be5e-5bfbd09e7fbe tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:55.814651 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-0803adf4-81a4-4e64-be5e-5bfbd09e7fbe tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:55.816206 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-0803adf4-81a4-4e64-be5e-5bfbd09e7fbe tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:55.817396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-0803adf4-81a4-4e64-be5e-5bfbd09e7fbe tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1724 microversion: 2.20 time: 0.166462 May 25 07:41:55.818042 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 317/652] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:41:55 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:41:56.498569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ea2da408-ccc0-44e7-937a-2760fd93cdc3 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:56.499128 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ea2da408-ccc0-44e7-937a-2760fd93cdc3 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:56.505727 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ea2da408-ccc0-44e7-937a-2760fd93cdc3 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:56.508716 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ea2da408-ccc0-44e7-937a-2760fd93cdc3 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:56.508716 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ea2da408-ccc0-44e7-937a-2760fd93cdc3 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:56.508716 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ea2da408-ccc0-44e7-937a-2760fd93cdc3 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:56.638755 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ea2da408-ccc0-44e7-937a-2760fd93cdc3 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:56.646264 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ea2da408-ccc0-44e7-937a-2760fd93cdc3 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1366 microversion: 2.1 time: 0.153451 May 25 07:41:56.646829 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 336/653] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:56 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:56.835965 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-26437504-0159-43e8-aa66-e10c544d9435 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:56.836600 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-26437504-0159-43e8-aa66-e10c544d9435 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:56.843784 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-26437504-0159-43e8-aa66-e10c544d9435 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:56.851320 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-26437504-0159-43e8-aa66-e10c544d9435 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:56.851320 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-26437504-0159-43e8-aa66-e10c544d9435 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:56.851320 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-26437504-0159-43e8-aa66-e10c544d9435 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:56.978650 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-26437504-0159-43e8-aa66-e10c544d9435 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:56.981387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=100 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:56.988792 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-26437504-0159-43e8-aa66-e10c544d9435 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:56.990603 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-26437504-0159-43e8-aa66-e10c544d9435 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:56.991461 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-26437504-0159-43e8-aa66-e10c544d9435 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1724 microversion: 2.20 time: 0.159382 May 25 07:41:56.992018 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 318/654] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:41:56 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:41:57.663088 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-62853f5f-eaeb-4df9-b73a-98c040f86a73 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:57.663710 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-62853f5f-eaeb-4df9-b73a-98c040f86a73 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:57.671107 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-62853f5f-eaeb-4df9-b73a-98c040f86a73 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:57.677688 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-62853f5f-eaeb-4df9-b73a-98c040f86a73 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:57.677688 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-62853f5f-eaeb-4df9-b73a-98c040f86a73 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:57.677688 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-62853f5f-eaeb-4df9-b73a-98c040f86a73 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:57.803530 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-62853f5f-eaeb-4df9-b73a-98c040f86a73 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:57.812078 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-62853f5f-eaeb-4df9-b73a-98c040f86a73 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1557 microversion: 2.1 time: 0.152862 May 25 07:41:57.812733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 337/655] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:41:57 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1557 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:41:57.828541 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-e3ec96af-9b0a-462a-9e50-0acacb19d1f6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:57.829034 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-e3ec96af-9b0a-462a-9e50-0acacb19d1f6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:57.831170 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=75,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:41:57.835945 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e3ec96af-9b0a-462a-9e50-0acacb19d1f6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:57.836396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e3ec96af-9b0a-462a-9e50-0acacb19d1f6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:57.844204 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e3ec96af-9b0a-462a-9e50-0acacb19d1f6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:57.844204 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e3ec96af-9b0a-462a-9e50-0acacb19d1f6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:57.914325 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-e3ec96af-9b0a-462a-9e50-0acacb19d1f6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.089771 May 25 07:41:57.914922 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 319/656] 10.222.0.24 () {58 vars in 1274 bytes} [Wed May 25 07:41:57 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-interface => generated 285 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:41:58.016584 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-5962be82-5bb5-4f02-afa9-91edb8b34a96 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:58.016584 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-5962be82-5bb5-4f02-afa9-91edb8b34a96 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:58.017298 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5962be82-5bb5-4f02-afa9-91edb8b34a96 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:58.017755 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5962be82-5bb5-4f02-afa9-91edb8b34a96 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:58.018818 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5962be82-5bb5-4f02-afa9-91edb8b34a96 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:58.019422 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5962be82-5bb5-4f02-afa9-91edb8b34a96 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:58.238903 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-5962be82-5bb5-4f02-afa9-91edb8b34a96 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:58.247537 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-5962be82-5bb5-4f02-afa9-91edb8b34a96 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:58.249109 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-5962be82-5bb5-4f02-afa9-91edb8b34a96 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:58.250307 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-5962be82-5bb5-4f02-afa9-91edb8b34a96 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1724 microversion: 2.20 time: 0.244290 May 25 07:41:58.250871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 338/657] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:41:58 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1724 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:41:58.942907 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-11b7b94d-de62-40cf-bcfd-5333617e546d req-1db79299-ffe6-4b0d-874f-daa55e2338b2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e1792da3-df94-4a97-9f39-a2200abfad07", "tag": "3879946e-3068-47dd-b88c-190f047d242d"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:41:58.952181 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-11b7b94d-de62-40cf-bcfd-5333617e546d req-1db79299-ffe6-4b0d-874f-daa55e2338b2 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:58.961425 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-11b7b94d-de62-40cf-bcfd-5333617e546d req-1db79299-ffe6-4b0d-874f-daa55e2338b2 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:58.963846 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-11b7b94d-de62-40cf-bcfd-5333617e546d req-1db79299-ffe6-4b0d-874f-daa55e2338b2 service nova] Creating event network-changed:3879946e-3068-47dd-b88c-190f047d242d for instance e1792da3-df94-4a97-9f39-a2200abfad07 on hv-cinder-82549 May 25 07:41:58.969138 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-11b7b94d-de62-40cf-bcfd-5333617e546d req-1db79299-ffe6-4b0d-874f-daa55e2338b2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030771 May 25 07:41:58.969943 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 320/658] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:41:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:41:59.268745 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-82c0f253-16cd-485f-b75f-0543ba5f093b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:41:59.269514 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-82c0f253-16cd-485f-b75f-0543ba5f093b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:41:59.275769 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-82c0f253-16cd-485f-b75f-0543ba5f093b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:59.276328 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-82c0f253-16cd-485f-b75f-0543ba5f093b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:59.277747 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-82c0f253-16cd-485f-b75f-0543ba5f093b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:41:59.278192 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-82c0f253-16cd-485f-b75f-0543ba5f093b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:41:59.405739 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-82c0f253-16cd-485f-b75f-0543ba5f093b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:59.413740 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-82c0f253-16cd-485f-b75f-0543ba5f093b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:59.415259 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-82c0f253-16cd-485f-b75f-0543ba5f093b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:41:59.416426 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-82c0f253-16cd-485f-b75f-0543ba5f093b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1724 microversion: 2.20 time: 0.151654 May 25 07:41:59.417021 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 339/659] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:41:59 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:42:00.436521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-a9e326a4-78f1-4bd3-a309-f27627728389 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:00.437221 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-a9e326a4-78f1-4bd3-a309-f27627728389 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:00.443513 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a9e326a4-78f1-4bd3-a309-f27627728389 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:00.443966 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a9e326a4-78f1-4bd3-a309-f27627728389 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:00.444762 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a9e326a4-78f1-4bd3-a309-f27627728389 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:00.445203 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a9e326a4-78f1-4bd3-a309-f27627728389 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:00.651570 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a9e326a4-78f1-4bd3-a309-f27627728389 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:00.660694 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a9e326a4-78f1-4bd3-a309-f27627728389 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:00.663153 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a9e326a4-78f1-4bd3-a309-f27627728389 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:00.663565 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-a9e326a4-78f1-4bd3-a309-f27627728389 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1724 microversion: 2.20 time: 0.232446 May 25 07:42:00.664131 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 321/660] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:00 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1724 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:42:01.681389 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-702a0c5d-dabb-4ab7-81ce-3d925b036964 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:01.682010 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-702a0c5d-dabb-4ab7-81ce-3d925b036964 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:01.688772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-702a0c5d-dabb-4ab7-81ce-3d925b036964 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:01.689231 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-702a0c5d-dabb-4ab7-81ce-3d925b036964 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:01.689998 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-702a0c5d-dabb-4ab7-81ce-3d925b036964 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:01.690445 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-702a0c5d-dabb-4ab7-81ce-3d925b036964 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:01.822801 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-702a0c5d-dabb-4ab7-81ce-3d925b036964 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:01.831083 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-702a0c5d-dabb-4ab7-81ce-3d925b036964 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:01.832622 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-702a0c5d-dabb-4ab7-81ce-3d925b036964 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:01.833815 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-702a0c5d-dabb-4ab7-81ce-3d925b036964 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1745 microversion: 2.20 time: 0.156491 May 25 07:42:01.834485 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 340/661] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:01 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:42:02.852455 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-bf952c26-5751-4779-9bbf-6bd2d6215aa6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:02.853183 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-bf952c26-5751-4779-9bbf-6bd2d6215aa6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:02.860829 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bf952c26-5751-4779-9bbf-6bd2d6215aa6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:02.861325 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bf952c26-5751-4779-9bbf-6bd2d6215aa6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:02.862603 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bf952c26-5751-4779-9bbf-6bd2d6215aa6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:02.863072 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bf952c26-5751-4779-9bbf-6bd2d6215aa6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:02.999663 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-bf952c26-5751-4779-9bbf-6bd2d6215aa6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:03.007671 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-bf952c26-5751-4779-9bbf-6bd2d6215aa6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:03.009172 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-bf952c26-5751-4779-9bbf-6bd2d6215aa6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:03.010327 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-bf952c26-5751-4779-9bbf-6bd2d6215aa6 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1745 microversion: 2.20 time: 0.162080 May 25 07:42:03.010888 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 322/662] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:02 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:42:04.029070 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-3b84cb3a-655d-4968-8619-9c9f4a995781 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:04.030372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-3b84cb3a-655d-4968-8619-9c9f4a995781 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:04.037261 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3b84cb3a-655d-4968-8619-9c9f4a995781 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:04.037919 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3b84cb3a-655d-4968-8619-9c9f4a995781 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:04.038719 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3b84cb3a-655d-4968-8619-9c9f4a995781 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:04.039352 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3b84cb3a-655d-4968-8619-9c9f4a995781 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:04.205589 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-3b84cb3a-655d-4968-8619-9c9f4a995781 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:04.214074 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-3b84cb3a-655d-4968-8619-9c9f4a995781 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:04.215948 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-3b84cb3a-655d-4968-8619-9c9f4a995781 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:04.217164 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-3b84cb3a-655d-4968-8619-9c9f4a995781 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1740 microversion: 2.20 time: 0.192404 May 25 07:42:04.217885 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 341/663] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:04 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1740 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:42:05.239150 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-ddccd5b7-d304-44b6-adae-bf29485ce6ad tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:05.240445 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-ddccd5b7-d304-44b6-adae-bf29485ce6ad tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:05.247856 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ddccd5b7-d304-44b6-adae-bf29485ce6ad tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:05.248747 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ddccd5b7-d304-44b6-adae-bf29485ce6ad tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:05.249756 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ddccd5b7-d304-44b6-adae-bf29485ce6ad tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:05.250272 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ddccd5b7-d304-44b6-adae-bf29485ce6ad tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:05.395799 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-ddccd5b7-d304-44b6-adae-bf29485ce6ad tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:05.406167 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-ddccd5b7-d304-44b6-adae-bf29485ce6ad tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:05.407913 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-ddccd5b7-d304-44b6-adae-bf29485ce6ad tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:05.409263 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-ddccd5b7-d304-44b6-adae-bf29485ce6ad tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1740 microversion: 2.20 time: 0.177007 May 25 07:42:05.409986 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 323/664] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:05 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:42:06.429851 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-6b50cf6c-28d8-46d0-9247-aff0a57f6798 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:06.430412 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-6b50cf6c-28d8-46d0-9247-aff0a57f6798 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:06.437697 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6b50cf6c-28d8-46d0-9247-aff0a57f6798 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:06.438147 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6b50cf6c-28d8-46d0-9247-aff0a57f6798 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:06.438959 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6b50cf6c-28d8-46d0-9247-aff0a57f6798 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:06.439395 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6b50cf6c-28d8-46d0-9247-aff0a57f6798 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:06.456024 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=100 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:06.578282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-6b50cf6c-28d8-46d0-9247-aff0a57f6798 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:06.589632 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-6b50cf6c-28d8-46d0-9247-aff0a57f6798 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:06.592245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-6b50cf6c-28d8-46d0-9247-aff0a57f6798 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:06.594787 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-6b50cf6c-28d8-46d0-9247-aff0a57f6798 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1740 microversion: 2.20 time: 0.168974 May 25 07:42:06.595526 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 342/665] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:06 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1740 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:42:07.624246 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-a0e91be8-d41d-4245-96f9-890a5266df7f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:07.625641 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-a0e91be8-d41d-4245-96f9-890a5266df7f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:07.637406 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a0e91be8-d41d-4245-96f9-890a5266df7f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:07.638412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a0e91be8-d41d-4245-96f9-890a5266df7f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:07.639846 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a0e91be8-d41d-4245-96f9-890a5266df7f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:07.640396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a0e91be8-d41d-4245-96f9-890a5266df7f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:07.799667 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a0e91be8-d41d-4245-96f9-890a5266df7f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:07.808424 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a0e91be8-d41d-4245-96f9-890a5266df7f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:07.811264 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a0e91be8-d41d-4245-96f9-890a5266df7f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:07.812451 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-a0e91be8-d41d-4245-96f9-890a5266df7f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1740 microversion: 2.20 time: 0.197227 May 25 07:42:07.813231 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 324/666] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:07 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1740 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:42:08.832249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-ffcbf138-bf26-44f1-bf77-42ede5356abd tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:08.833012 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-ffcbf138-bf26-44f1-bf77-42ede5356abd tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:08.840019 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ffcbf138-bf26-44f1-bf77-42ede5356abd tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:08.841326 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ffcbf138-bf26-44f1-bf77-42ede5356abd tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:08.842448 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ffcbf138-bf26-44f1-bf77-42ede5356abd tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:08.842997 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ffcbf138-bf26-44f1-bf77-42ede5356abd tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:08.884618 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-92ea9580-f082-4ad5-ad43-965d71b909d0 req-5bf3ec30-d96d-4edf-928c-0878c2dd3472 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ecec15-f302-4eea-92e6-37049703fa41", "name": "network-vif-plugged", "status": "completed", "tag": "28f4b108-96e9-447b-88dd-ed92dc19d98c"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:42:08.899037 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-92ea9580-f082-4ad5-ad43-965d71b909d0 req-5bf3ec30-d96d-4edf-928c-0878c2dd3472 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:08.901336 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-92ea9580-f082-4ad5-ad43-965d71b909d0 req-5bf3ec30-d96d-4edf-928c-0878c2dd3472 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:08.922008 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-92ea9580-f082-4ad5-ad43-965d71b909d0 req-5bf3ec30-d96d-4edf-928c-0878c2dd3472 service nova] Creating event network-vif-plugged:28f4b108-96e9-447b-88dd-ed92dc19d98c for instance c0ecec15-f302-4eea-92e6-37049703fa41 on hv-cinder-82549 May 25 07:42:08.927871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-92ea9580-f082-4ad5-ad43-965d71b909d0 req-5bf3ec30-d96d-4edf-928c-0878c2dd3472 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.119814 May 25 07:42:08.929035 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 343/667] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:42:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:42:09.044826 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-ffcbf138-bf26-44f1-bf77-42ede5356abd tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:09.053803 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-ffcbf138-bf26-44f1-bf77-42ede5356abd tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:09.055672 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-ffcbf138-bf26-44f1-bf77-42ede5356abd tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:09.057121 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-ffcbf138-bf26-44f1-bf77-42ede5356abd tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1740 microversion: 2.20 time: 0.229565 May 25 07:42:09.060528 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 325/668] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:08 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1740 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:42:10.081110 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-3ab47b3b-2dea-4ecc-9d8b-30eaced6af83 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:10.081836 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-3ab47b3b-2dea-4ecc-9d8b-30eaced6af83 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:10.087970 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3ab47b3b-2dea-4ecc-9d8b-30eaced6af83 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:10.088427 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3ab47b3b-2dea-4ecc-9d8b-30eaced6af83 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:10.089224 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3ab47b3b-2dea-4ecc-9d8b-30eaced6af83 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:10.089662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3ab47b3b-2dea-4ecc-9d8b-30eaced6af83 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:10.224003 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-3ab47b3b-2dea-4ecc-9d8b-30eaced6af83 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:10.235161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-3ab47b3b-2dea-4ecc-9d8b-30eaced6af83 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:10.235161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-3ab47b3b-2dea-4ecc-9d8b-30eaced6af83 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:10.236149 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-3ab47b3b-2dea-4ecc-9d8b-30eaced6af83 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1740 microversion: 2.20 time: 0.159828 May 25 07:42:10.248002 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 344/669] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:10 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:42:11.260097 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-3f8dee6a-b69e-41c4-822a-2f64385b61ef tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:11.260937 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-3f8dee6a-b69e-41c4-822a-2f64385b61ef tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:11.274620 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3f8dee6a-b69e-41c4-822a-2f64385b61ef tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:11.275064 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3f8dee6a-b69e-41c4-822a-2f64385b61ef tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:11.276523 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3f8dee6a-b69e-41c4-822a-2f64385b61ef tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:11.277158 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3f8dee6a-b69e-41c4-822a-2f64385b61ef tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:11.421551 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-3f8dee6a-b69e-41c4-822a-2f64385b61ef tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:11.430030 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-3f8dee6a-b69e-41c4-822a-2f64385b61ef tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:11.431852 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-3f8dee6a-b69e-41c4-822a-2f64385b61ef tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:11.433050 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-3f8dee6a-b69e-41c4-822a-2f64385b61ef tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1740 microversion: 2.20 time: 0.176936 May 25 07:42:11.444861 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 326/670] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:11 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1740 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:42:12.454325 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-91ab97f0-63b6-4fe1-8d23-b5b2f0f77a11 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:12.454943 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-91ab97f0-63b6-4fe1-8d23-b5b2f0f77a11 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:12.464349 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-91ab97f0-63b6-4fe1-8d23-b5b2f0f77a11 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:12.465382 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-91ab97f0-63b6-4fe1-8d23-b5b2f0f77a11 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:12.466583 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-91ab97f0-63b6-4fe1-8d23-b5b2f0f77a11 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:12.467200 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-91ab97f0-63b6-4fe1-8d23-b5b2f0f77a11 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:12.636497 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-91ab97f0-63b6-4fe1-8d23-b5b2f0f77a11 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:12.648027 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-91ab97f0-63b6-4fe1-8d23-b5b2f0f77a11 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:12.650127 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-91ab97f0-63b6-4fe1-8d23-b5b2f0f77a11 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:12.663463 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-91ab97f0-63b6-4fe1-8d23-b5b2f0f77a11 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1740 microversion: 2.20 time: 0.202395 May 25 07:42:12.663463 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 345/671] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:12 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1740 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:42:13.672126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-5931438a-16ae-46f1-811e-2eb345b8d438 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:13.672821 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-5931438a-16ae-46f1-811e-2eb345b8d438 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:13.679742 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5931438a-16ae-46f1-811e-2eb345b8d438 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:13.680195 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5931438a-16ae-46f1-811e-2eb345b8d438 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:13.681287 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5931438a-16ae-46f1-811e-2eb345b8d438 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:13.682381 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5931438a-16ae-46f1-811e-2eb345b8d438 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:13.819661 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-5931438a-16ae-46f1-811e-2eb345b8d438 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:13.829439 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-5931438a-16ae-46f1-811e-2eb345b8d438 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:13.831267 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-5931438a-16ae-46f1-811e-2eb345b8d438 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:13.832433 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-5931438a-16ae-46f1-811e-2eb345b8d438 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1740 microversion: 2.20 time: 0.165226 May 25 07:42:13.833195 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 327/672] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:13 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:42:14.850387 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-15445830-d04b-49a9-98ac-f964ffa53ee1 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:14.851537 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-15445830-d04b-49a9-98ac-f964ffa53ee1 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:14.858583 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-15445830-d04b-49a9-98ac-f964ffa53ee1 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:14.859799 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-15445830-d04b-49a9-98ac-f964ffa53ee1 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:14.859799 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-15445830-d04b-49a9-98ac-f964ffa53ee1 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:14.860217 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-15445830-d04b-49a9-98ac-f964ffa53ee1 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:14.999578 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-15445830-d04b-49a9-98ac-f964ffa53ee1 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:15.009574 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-15445830-d04b-49a9-98ac-f964ffa53ee1 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:15.013858 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-15445830-d04b-49a9-98ac-f964ffa53ee1 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:15.013858 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-15445830-d04b-49a9-98ac-f964ffa53ee1 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1740 microversion: 2.20 time: 0.166048 May 25 07:42:15.013858 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 346/673] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:14 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1740 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:42:16.031659 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-3d0aa4a8-ed17-4be0-b458-5bff8a0ac810 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:16.032380 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-3d0aa4a8-ed17-4be0-b458-5bff8a0ac810 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:16.039002 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3d0aa4a8-ed17-4be0-b458-5bff8a0ac810 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:16.039444 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3d0aa4a8-ed17-4be0-b458-5bff8a0ac810 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:16.040220 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3d0aa4a8-ed17-4be0-b458-5bff8a0ac810 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:16.040693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3d0aa4a8-ed17-4be0-b458-5bff8a0ac810 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:16.174906 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-3d0aa4a8-ed17-4be0-b458-5bff8a0ac810 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:16.188462 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-3d0aa4a8-ed17-4be0-b458-5bff8a0ac810 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:16.188462 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-3d0aa4a8-ed17-4be0-b458-5bff8a0ac810 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:16.188462 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-3d0aa4a8-ed17-4be0-b458-5bff8a0ac810 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1722 microversion: 2.20 time: 0.158509 May 25 07:42:16.188791 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 328/674] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:16 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1722 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:42:17.204178 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-beaed6bd-c6f3-43ed-8d91-7e64b6ae0aed tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:17.204887 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-beaed6bd-c6f3-43ed-8d91-7e64b6ae0aed tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:17.211590 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-beaed6bd-c6f3-43ed-8d91-7e64b6ae0aed tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:17.214333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-beaed6bd-c6f3-43ed-8d91-7e64b6ae0aed tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:17.214333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-beaed6bd-c6f3-43ed-8d91-7e64b6ae0aed tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:17.214333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-beaed6bd-c6f3-43ed-8d91-7e64b6ae0aed tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:17.343853 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-beaed6bd-c6f3-43ed-8d91-7e64b6ae0aed tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:17.352254 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-beaed6bd-c6f3-43ed-8d91-7e64b6ae0aed tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:17.353753 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-beaed6bd-c6f3-43ed-8d91-7e64b6ae0aed tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:17.354962 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-beaed6bd-c6f3-43ed-8d91-7e64b6ae0aed tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1722 microversion: 2.20 time: 0.154814 May 25 07:42:17.355667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 347/675] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:17 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:42:18.374590 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-a955df74-e4b2-4184-9d0e-9ecff9355a84 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:18.375225 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-a955df74-e4b2-4184-9d0e-9ecff9355a84 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:18.381612 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a955df74-e4b2-4184-9d0e-9ecff9355a84 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:18.382060 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a955df74-e4b2-4184-9d0e-9ecff9355a84 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:18.382815 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a955df74-e4b2-4184-9d0e-9ecff9355a84 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:18.383247 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a955df74-e4b2-4184-9d0e-9ecff9355a84 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:18.522820 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a955df74-e4b2-4184-9d0e-9ecff9355a84 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:18.528854 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a955df74-e4b2-4184-9d0e-9ecff9355a84 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:18.530415 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a955df74-e4b2-4184-9d0e-9ecff9355a84 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:18.531632 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-a955df74-e4b2-4184-9d0e-9ecff9355a84 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1725 microversion: 2.20 time: 0.161707 May 25 07:42:18.532312 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 329/676] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:18 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:42:18.549717 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-2f7b12da-2c1e-427c-ac05-f2c2df00739e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "95c1bf6b-d50e-403a-a7f2-3a64b341eebe"}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:42:18.550782 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-2f7b12da-2c1e-427c-ac05-f2c2df00739e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:18.554325 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=40 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:18.557797 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2f7b12da-2c1e-427c-ac05-f2c2df00739e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:18.558256 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2f7b12da-2c1e-427c-ac05-f2c2df00739e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:18.559037 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2f7b12da-2c1e-427c-ac05-f2c2df00739e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:18.559475 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2f7b12da-2c1e-427c-ac05-f2c2df00739e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:18.803995 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-8ab7cccd-9106-4f73-b0d9-fef673f6ba55 req-68b0ceac-2adf-480a-a519-6a1112090a26 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ecec15-f302-4eea-92e6-37049703fa41", "name": "network-vif-unplugged", "status": "completed", "tag": "28f4b108-96e9-447b-88dd-ed92dc19d98c"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:42:18.812625 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-8ab7cccd-9106-4f73-b0d9-fef673f6ba55 req-68b0ceac-2adf-480a-a519-6a1112090a26 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:18.812625 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-8ab7cccd-9106-4f73-b0d9-fef673f6ba55 req-68b0ceac-2adf-480a-a519-6a1112090a26 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:18.821614 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.compute.server_external_events [req-8ab7cccd-9106-4f73-b0d9-fef673f6ba55 req-68b0ceac-2adf-480a-a519-6a1112090a26 service nova] Unable to find a host for instance c0ecec15-f302-4eea-92e6-37049703fa41. Dropping event network-vif-unplugged {{(pid=124674) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 25 07:42:18.822491 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-8ab7cccd-9106-4f73-b0d9-fef673f6ba55 req-68b0ceac-2adf-480a-a519-6a1112090a26 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.025625 May 25 07:42:18.823061 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 330/677] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:42:18 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) May 25 07:42:19.722760 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-2f7b12da-2c1e-427c-ac05-f2c2df00739e tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "POST /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.176943 May 25 07:42:19.723383 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 348/678] 10.222.0.24 () {62 vars in 1363 bytes} [Wed May 25 07:42:18 2022] POST /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41/os-volume_attachments => generated 188 bytes in 1178 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) May 25 07:42:19.837475 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-e384d56e-6460-4ab6-9b86-c2134dde3e1d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:19.838291 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-e384d56e-6460-4ab6-9b86-c2134dde3e1d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:19.844553 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e384d56e-6460-4ab6-9b86-c2134dde3e1d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:19.845006 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e384d56e-6460-4ab6-9b86-c2134dde3e1d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:19.845774 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e384d56e-6460-4ab6-9b86-c2134dde3e1d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:19.846208 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e384d56e-6460-4ab6-9b86-c2134dde3e1d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:20.465627 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-e384d56e-6460-4ab6-9b86-c2134dde3e1d tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41/os-volume_attachments/95c1bf6b-d50e-403a-a7f2-3a64b341eebe" status: 202 len: 0 microversion: 2.20 time: 0.631998 May 25 07:42:20.466743 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 331/679] 10.222.0.24 () {60 vars in 1456 bytes} [Wed May 25 07:42:19 2022] DELETE /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41/os-volume_attachments/95c1bf6b-d50e-403a-a7f2-3a64b341eebe => generated 0 bytes in 634 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 07:42:20.525272 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-72c31263-7ebe-40f7-830b-7e92e47b22d7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:42:20.525846 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-72c31263-7ebe-40f7-830b-7e92e47b22d7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:20.532087 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-72c31263-7ebe-40f7-830b-7e92e47b22d7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:20.532556 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-72c31263-7ebe-40f7-830b-7e92e47b22d7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:20.533368 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-72c31263-7ebe-40f7-830b-7e92e47b22d7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:20.533784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-72c31263-7ebe-40f7-830b-7e92e47b22d7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:20.982528 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-72c31263-7ebe-40f7-830b-7e92e47b22d7 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "POST /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41/action" status: 202 len: 0 microversion: 2.20 time: 0.461227 May 25 07:42:20.986205 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 349/680] 10.222.0.24 () {62 vars in 1318 bytes} [Wed May 25 07:42:20 2022] POST /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41/action => generated 0 bytes in 463 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) May 25 07:42:20.991542 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-43251b1f-ff45-42d7-bc38-e91de01da0e4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:20.992156 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-43251b1f-ff45-42d7-bc38-e91de01da0e4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:21.000747 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-43251b1f-ff45-42d7-bc38-e91de01da0e4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:21.002054 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-43251b1f-ff45-42d7-bc38-e91de01da0e4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:21.002054 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-43251b1f-ff45-42d7-bc38-e91de01da0e4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:21.002717 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-43251b1f-ff45-42d7-bc38-e91de01da0e4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:21.144064 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-43251b1f-ff45-42d7-bc38-e91de01da0e4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:21.152506 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-43251b1f-ff45-42d7-bc38-e91de01da0e4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:21.154102 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-43251b1f-ff45-42d7-bc38-e91de01da0e4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:21.157637 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-43251b1f-ff45-42d7-bc38-e91de01da0e4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1673 microversion: 2.20 time: 0.167919 May 25 07:42:21.157637 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 332/681] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:20 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1673 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:42:22.175553 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a75bcfce-0f21-4c05-80b0-6a7d21089ab9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:22.180304 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a75bcfce-0f21-4c05-80b0-6a7d21089ab9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:22.182448 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a75bcfce-0f21-4c05-80b0-6a7d21089ab9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:22.183132 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a75bcfce-0f21-4c05-80b0-6a7d21089ab9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:22.183662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a75bcfce-0f21-4c05-80b0-6a7d21089ab9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:22.184103 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a75bcfce-0f21-4c05-80b0-6a7d21089ab9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:22.320252 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a75bcfce-0f21-4c05-80b0-6a7d21089ab9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:22.330179 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a75bcfce-0f21-4c05-80b0-6a7d21089ab9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:22.331957 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a75bcfce-0f21-4c05-80b0-6a7d21089ab9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:22.333510 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a75bcfce-0f21-4c05-80b0-6a7d21089ab9 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1673 microversion: 2.20 time: 0.162472 May 25 07:42:22.334865 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 350/682] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:22 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1673 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:42:22.834899 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-3898d643-924f-4631-a57c-d8469030c80e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:22.835406 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-3898d643-924f-4631-a57c-d8469030c80e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:22.850125 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3898d643-924f-4631-a57c-d8469030c80e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:22.850125 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3898d643-924f-4631-a57c-d8469030c80e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:22.850125 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3898d643-924f-4631-a57c-d8469030c80e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:22.850125 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3898d643-924f-4631-a57c-d8469030c80e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:22.867078 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-3898d643-924f-4631-a57c-d8469030c80e tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/ips" status: 200 len: 144 microversion: 2.1 time: 0.204278 May 25 07:42:22.867685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 333/683] 10.222.0.24 () {58 vars in 1247 bytes} [Wed May 25 07:42:22 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/ips => generated 144 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:42:23.352343 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-3e3ffa8a-2b85-40b9-89bf-10db040fd869 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:23.353026 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-3e3ffa8a-2b85-40b9-89bf-10db040fd869 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:23.360025 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3e3ffa8a-2b85-40b9-89bf-10db040fd869 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:23.360470 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3e3ffa8a-2b85-40b9-89bf-10db040fd869 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:23.361272 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3e3ffa8a-2b85-40b9-89bf-10db040fd869 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:23.361708 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3e3ffa8a-2b85-40b9-89bf-10db040fd869 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:23.519933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-3e3ffa8a-2b85-40b9-89bf-10db040fd869 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:23.537477 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-3e3ffa8a-2b85-40b9-89bf-10db040fd869 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:23.539331 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-3e3ffa8a-2b85-40b9-89bf-10db040fd869 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:23.541076 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-3e3ffa8a-2b85-40b9-89bf-10db040fd869 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1731 microversion: 2.20 time: 0.192703 May 25 07:42:23.553283 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 351/684] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:23 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1731 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:42:24.551362 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-147b3e34-3c6f-4d18-b45f-a1b6e47734a9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "69f6a2c9-ad9e-4255-bca9-5e0d8e29867f"}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:42:24.555942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-147b3e34-3c6f-4d18-b45f-a1b6e47734a9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:24.562746 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-720707b9-6fd8-4bd6-a6e4-22359bdc3e64 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:24.563477 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-720707b9-6fd8-4bd6-a6e4-22359bdc3e64 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:24.564317 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-147b3e34-3c6f-4d18-b45f-a1b6e47734a9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:24.565657 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-147b3e34-3c6f-4d18-b45f-a1b6e47734a9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:24.566676 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-147b3e34-3c6f-4d18-b45f-a1b6e47734a9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:24.567396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-147b3e34-3c6f-4d18-b45f-a1b6e47734a9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:24.571441 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-720707b9-6fd8-4bd6-a6e4-22359bdc3e64 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:24.571898 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-720707b9-6fd8-4bd6-a6e4-22359bdc3e64 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:24.572709 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-720707b9-6fd8-4bd6-a6e4-22359bdc3e64 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:24.588966 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-720707b9-6fd8-4bd6-a6e4-22359bdc3e64 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:24.658646 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:24.841907 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-720707b9-6fd8-4bd6-a6e4-22359bdc3e64 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:24.851146 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-720707b9-6fd8-4bd6-a6e4-22359bdc3e64 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:24.854965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-720707b9-6fd8-4bd6-a6e4-22359bdc3e64 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:24.856411 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-720707b9-6fd8-4bd6-a6e4-22359bdc3e64 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1731 microversion: 2.20 time: 0.299289 May 25 07:42:24.857867 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 352/685] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:24 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1731 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:42:25.876314 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-21e575eb-e78a-4c34-88df-c356ec8d24ab tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:25.877005 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-21e575eb-e78a-4c34-88df-c356ec8d24ab tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:25.883833 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-21e575eb-e78a-4c34-88df-c356ec8d24ab tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:25.884359 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-21e575eb-e78a-4c34-88df-c356ec8d24ab tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:25.885241 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-21e575eb-e78a-4c34-88df-c356ec8d24ab tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:25.885749 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-21e575eb-e78a-4c34-88df-c356ec8d24ab tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:26.029909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-21e575eb-e78a-4c34-88df-c356ec8d24ab tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:26.038711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-21e575eb-e78a-4c34-88df-c356ec8d24ab tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:26.040536 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-21e575eb-e78a-4c34-88df-c356ec8d24ab tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:26.041892 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-21e575eb-e78a-4c34-88df-c356ec8d24ab tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1731 microversion: 2.20 time: 0.170554 May 25 07:42:26.042442 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 353/686] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:25 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:42:27.060497 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-56f0c2ca-3513-4004-92ea-ef718ee7c915 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:27.061843 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-56f0c2ca-3513-4004-92ea-ef718ee7c915 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:27.068263 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-56f0c2ca-3513-4004-92ea-ef718ee7c915 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:27.068755 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-56f0c2ca-3513-4004-92ea-ef718ee7c915 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:27.069542 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-56f0c2ca-3513-4004-92ea-ef718ee7c915 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:27.070019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-56f0c2ca-3513-4004-92ea-ef718ee7c915 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:27.212821 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-56f0c2ca-3513-4004-92ea-ef718ee7c915 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:27.222167 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-56f0c2ca-3513-4004-92ea-ef718ee7c915 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:27.223886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-56f0c2ca-3513-4004-92ea-ef718ee7c915 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:27.225180 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-56f0c2ca-3513-4004-92ea-ef718ee7c915 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1731 microversion: 2.20 time: 0.169229 May 25 07:42:27.225819 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 354/687] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:27 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1731 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:42:28.243828 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-fe0c36b4-2873-44f4-8700-8ad2d0800468 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:28.244597 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-fe0c36b4-2873-44f4-8700-8ad2d0800468 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:28.252306 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fe0c36b4-2873-44f4-8700-8ad2d0800468 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:28.252799 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fe0c36b4-2873-44f4-8700-8ad2d0800468 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:28.253604 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fe0c36b4-2873-44f4-8700-8ad2d0800468 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:28.254054 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fe0c36b4-2873-44f4-8700-8ad2d0800468 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:28.407935 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-fe0c36b4-2873-44f4-8700-8ad2d0800468 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:28.417976 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-fe0c36b4-2873-44f4-8700-8ad2d0800468 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:28.421036 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-fe0c36b4-2873-44f4-8700-8ad2d0800468 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:28.422267 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-fe0c36b4-2873-44f4-8700-8ad2d0800468 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1731 microversion: 2.20 time: 0.182465 May 25 07:42:28.426559 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 355/688] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:28 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1731 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:42:29.443011 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-e394b795-cb27-4dec-809b-b0fef6c4d3bc tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:29.443685 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-e394b795-cb27-4dec-809b-b0fef6c4d3bc tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:29.451548 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e394b795-cb27-4dec-809b-b0fef6c4d3bc tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:29.452078 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e394b795-cb27-4dec-809b-b0fef6c4d3bc tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:29.452961 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e394b795-cb27-4dec-809b-b0fef6c4d3bc tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:29.453474 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e394b795-cb27-4dec-809b-b0fef6c4d3bc tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:29.456294 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:29.600257 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-e394b795-cb27-4dec-809b-b0fef6c4d3bc tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:29.608497 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-e394b795-cb27-4dec-809b-b0fef6c4d3bc tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:29.610026 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-e394b795-cb27-4dec-809b-b0fef6c4d3bc tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:29.611213 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-e394b795-cb27-4dec-809b-b0fef6c4d3bc tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1731 microversion: 2.20 time: 0.172816 May 25 07:42:29.611771 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 356/689] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:29 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:42:30.076515 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-aaacaf8e-35be-41b6-9554-06b8d2648bc0 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:42:30.077066 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-aaacaf8e-35be-41b6-9554-06b8d2648bc0 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:30.083357 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-aaacaf8e-35be-41b6-9554-06b8d2648bc0 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:30.083807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-aaacaf8e-35be-41b6-9554-06b8d2648bc0 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:30.084617 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-aaacaf8e-35be-41b6-9554-06b8d2648bc0 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:30.085059 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-aaacaf8e-35be-41b6-9554-06b8d2648bc0 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:30.110439 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.objects.instance [None req-aaacaf8e-35be-41b6-9554-06b8d2648bc0 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lazy-loading 'flavor' on Instance uuid 63430b83-f298-430c-9ca9-bdd4d69bde91 {{(pid=124675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:42:30.421672 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-aaacaf8e-35be-41b6-9554-06b8d2648bc0 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "POST /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91/action" status: 202 len: 0 microversion: 2.1 time: 0.349116 May 25 07:42:30.422487 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 357/690] 10.222.0.24 () {60 vars in 1277 bytes} [Wed May 25 07:42:30 2022] POST /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91/action => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 07:42:30.431772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-103c7914-b6e5-45e7-b5b3-2537404049d9 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:30.444663 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-103c7914-b6e5-45e7-b5b3-2537404049d9 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:30.458999 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-103c7914-b6e5-45e7-b5b3-2537404049d9 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:30.459499 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-103c7914-b6e5-45e7-b5b3-2537404049d9 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:30.460348 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-103c7914-b6e5-45e7-b5b3-2537404049d9 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:30.460861 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-103c7914-b6e5-45e7-b5b3-2537404049d9 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:30.652363 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-103c7914-b6e5-45e7-b5b3-2537404049d9 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:30.662214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-103c7914-b6e5-45e7-b5b3-2537404049d9 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1568 microversion: 2.1 time: 0.235125 May 25 07:42:30.672692 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 358/691] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:30 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1568 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:42:30.679139 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a17a6b30-508b-4e8f-a74f-63ae279b2da5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:30.680110 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a17a6b30-508b-4e8f-a74f-63ae279b2da5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:30.686976 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a17a6b30-508b-4e8f-a74f-63ae279b2da5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:30.696900 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a17a6b30-508b-4e8f-a74f-63ae279b2da5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:30.696900 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a17a6b30-508b-4e8f-a74f-63ae279b2da5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:30.696900 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a17a6b30-508b-4e8f-a74f-63ae279b2da5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:30.842641 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a17a6b30-508b-4e8f-a74f-63ae279b2da5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:30.850126 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a17a6b30-508b-4e8f-a74f-63ae279b2da5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:30.851645 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a17a6b30-508b-4e8f-a74f-63ae279b2da5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:30.852870 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a17a6b30-508b-4e8f-a74f-63ae279b2da5 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1731 microversion: 2.20 time: 0.188384 May 25 07:42:30.853678 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 359/692] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:30 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1731 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:42:31.683412 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4cc15ede-69c5-4b9e-9b24-37a5e4229681 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:31.684382 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4cc15ede-69c5-4b9e-9b24-37a5e4229681 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:31.693415 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4cc15ede-69c5-4b9e-9b24-37a5e4229681 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:31.695147 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4cc15ede-69c5-4b9e-9b24-37a5e4229681 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:31.698669 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4cc15ede-69c5-4b9e-9b24-37a5e4229681 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:31.699182 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4cc15ede-69c5-4b9e-9b24-37a5e4229681 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:31.854293 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4cc15ede-69c5-4b9e-9b24-37a5e4229681 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:31.880691 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4cc15ede-69c5-4b9e-9b24-37a5e4229681 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1568 microversion: 2.1 time: 0.195929 May 25 07:42:31.884535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 360/693] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:31 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1568 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:31.894623 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-6eec07a7-d42e-45f5-8b43-552acb709d90 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:31.895642 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-6eec07a7-d42e-45f5-8b43-552acb709d90 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:31.902494 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6eec07a7-d42e-45f5-8b43-552acb709d90 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:31.902948 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6eec07a7-d42e-45f5-8b43-552acb709d90 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:31.904429 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6eec07a7-d42e-45f5-8b43-552acb709d90 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:31.905112 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6eec07a7-d42e-45f5-8b43-552acb709d90 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:32.045651 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-6eec07a7-d42e-45f5-8b43-552acb709d90 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:32.054549 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-6eec07a7-d42e-45f5-8b43-552acb709d90 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:32.057086 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-6eec07a7-d42e-45f5-8b43-552acb709d90 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:32.058401 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-6eec07a7-d42e-45f5-8b43-552acb709d90 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1731 microversion: 2.20 time: 0.174544 May 25 07:42:32.059189 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 361/694] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:31 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1731 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:42:32.898115 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-2959dac2-a160-4d42-aebe-ea0c0851c1a0 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:32.898759 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-2959dac2-a160-4d42-aebe-ea0c0851c1a0 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:32.908875 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2959dac2-a160-4d42-aebe-ea0c0851c1a0 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:32.908875 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2959dac2-a160-4d42-aebe-ea0c0851c1a0 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:32.908875 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2959dac2-a160-4d42-aebe-ea0c0851c1a0 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:32.908875 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2959dac2-a160-4d42-aebe-ea0c0851c1a0 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:33.043540 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-2959dac2-a160-4d42-aebe-ea0c0851c1a0 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:33.051347 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-2959dac2-a160-4d42-aebe-ea0c0851c1a0 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1568 microversion: 2.1 time: 0.157209 May 25 07:42:33.051919 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 362/695] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:32 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:42:33.081967 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-cd49309d-4bad-4f6d-99ee-c57241fd7cbd tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:33.082556 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-cd49309d-4bad-4f6d-99ee-c57241fd7cbd tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:33.088460 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cd49309d-4bad-4f6d-99ee-c57241fd7cbd tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:33.088943 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cd49309d-4bad-4f6d-99ee-c57241fd7cbd tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:33.089707 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cd49309d-4bad-4f6d-99ee-c57241fd7cbd tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:33.090141 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cd49309d-4bad-4f6d-99ee-c57241fd7cbd tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:33.225974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-cd49309d-4bad-4f6d-99ee-c57241fd7cbd tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:33.234001 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-cd49309d-4bad-4f6d-99ee-c57241fd7cbd tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:33.235511 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-cd49309d-4bad-4f6d-99ee-c57241fd7cbd tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:33.236703 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-cd49309d-4bad-4f6d-99ee-c57241fd7cbd tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1731 microversion: 2.20 time: 0.158657 May 25 07:42:33.237261 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 363/696] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:33 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1731 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:42:33.510094 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-147b3e34-3c6f-4d18-b45f-a1b6e47734a9 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "POST /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 8.962605 May 25 07:42:33.510768 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 334/697] 10.222.0.24 () {60 vars in 1322 bytes} [Wed May 25 07:42:24 2022] POST /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments => generated 194 bytes in 8964 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:42:34.069346 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-9a1b1037-5c8e-41b3-b936-4c6b8c47aa23 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:34.069892 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-9a1b1037-5c8e-41b3-b936-4c6b8c47aa23 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:34.077558 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9a1b1037-5c8e-41b3-b936-4c6b8c47aa23 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:34.078022 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9a1b1037-5c8e-41b3-b936-4c6b8c47aa23 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:34.079077 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9a1b1037-5c8e-41b3-b936-4c6b8c47aa23 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:34.079533 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9a1b1037-5c8e-41b3-b936-4c6b8c47aa23 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:34.223603 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-9a1b1037-5c8e-41b3-b936-4c6b8c47aa23 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:34.231765 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-9a1b1037-5c8e-41b3-b936-4c6b8c47aa23 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1568 microversion: 2.1 time: 0.166662 May 25 07:42:34.232348 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 364/698] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:34 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1568 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:34.256031 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7f8417fd-cfc4-4b1b-b96b-2485d485bb48 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:34.256778 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-7f8417fd-cfc4-4b1b-b96b-2485d485bb48 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:34.262158 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=32 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:34.265881 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7f8417fd-cfc4-4b1b-b96b-2485d485bb48 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:34.266326 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7f8417fd-cfc4-4b1b-b96b-2485d485bb48 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:34.267141 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7f8417fd-cfc4-4b1b-b96b-2485d485bb48 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:34.267573 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7f8417fd-cfc4-4b1b-b96b-2485d485bb48 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:34.401517 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7f8417fd-cfc4-4b1b-b96b-2485d485bb48 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:34.410810 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7f8417fd-cfc4-4b1b-b96b-2485d485bb48 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:34.415983 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7f8417fd-cfc4-4b1b-b96b-2485d485bb48 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:34.415983 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-7f8417fd-cfc4-4b1b-b96b-2485d485bb48 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1731 microversion: 2.20 time: 0.161802 May 25 07:42:34.415983 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 335/699] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:34 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:42:35.087395 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-317a632f-1f23-41f0-8a1b-e035e99fa5ea tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:35.087906 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-317a632f-1f23-41f0-8a1b-e035e99fa5ea tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:35.095485 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-317a632f-1f23-41f0-8a1b-e035e99fa5ea tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:35.095939 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-317a632f-1f23-41f0-8a1b-e035e99fa5ea tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:35.096745 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-317a632f-1f23-41f0-8a1b-e035e99fa5ea tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:35.097184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-317a632f-1f23-41f0-8a1b-e035e99fa5ea tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:35.120153 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-317a632f-1f23-41f0-8a1b-e035e99fa5ea tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/ips" status: 200 len: 151 microversion: 2.1 time: 0.037898 May 25 07:42:35.120823 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 365/700] 10.222.0.24 () {58 vars in 1247 bytes} [Wed May 25 07:42:35 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/ips => generated 151 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:42:35.251265 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-047a7e02-642f-46cd-b17f-25d95526f823 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:35.252560 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-047a7e02-642f-46cd-b17f-25d95526f823 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:35.263833 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-047a7e02-642f-46cd-b17f-25d95526f823 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:35.264596 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-047a7e02-642f-46cd-b17f-25d95526f823 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:35.265456 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-047a7e02-642f-46cd-b17f-25d95526f823 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:35.265963 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-047a7e02-642f-46cd-b17f-25d95526f823 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:35.437134 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a1e02794-ca96-4069-9944-805c07b80eae tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:35.438357 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a1e02794-ca96-4069-9944-805c07b80eae tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:35.445371 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a1e02794-ca96-4069-9944-805c07b80eae tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:35.445830 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a1e02794-ca96-4069-9944-805c07b80eae tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:35.447174 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a1e02794-ca96-4069-9944-805c07b80eae tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:35.447832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a1e02794-ca96-4069-9944-805c07b80eae tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:35.682184 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a1e02794-ca96-4069-9944-805c07b80eae tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:35.690209 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a1e02794-ca96-4069-9944-805c07b80eae tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:35.691862 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a1e02794-ca96-4069-9944-805c07b80eae tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:35.693337 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a1e02794-ca96-4069-9944-805c07b80eae tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1731 microversion: 2.20 time: 0.264513 May 25 07:42:35.694009 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 366/701] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:35 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1731 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:42:35.751354 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-047a7e02-642f-46cd-b17f-25d95526f823 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:35.776314 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-047a7e02-642f-46cd-b17f-25d95526f823 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1568 microversion: 2.1 time: 0.513506 May 25 07:42:35.776314 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 336/702] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:35 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1568 bytes in 515 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:42:36.713350 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-95f74def-1e95-4c1e-89de-877540ab51e3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:36.715153 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-95f74def-1e95-4c1e-89de-877540ab51e3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:36.725141 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-95f74def-1e95-4c1e-89de-877540ab51e3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:36.725598 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-95f74def-1e95-4c1e-89de-877540ab51e3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:36.726390 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-95f74def-1e95-4c1e-89de-877540ab51e3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:36.726836 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-95f74def-1e95-4c1e-89de-877540ab51e3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:36.783699 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-e35cab37-c19c-43c0-8ba5-ec6e261efa66 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:36.784928 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-e35cab37-c19c-43c0-8ba5-ec6e261efa66 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:36.791581 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e35cab37-c19c-43c0-8ba5-ec6e261efa66 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:36.792036 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e35cab37-c19c-43c0-8ba5-ec6e261efa66 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:36.797711 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e35cab37-c19c-43c0-8ba5-ec6e261efa66 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:36.798152 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e35cab37-c19c-43c0-8ba5-ec6e261efa66 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:36.889606 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-95f74def-1e95-4c1e-89de-877540ab51e3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:36.899966 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-95f74def-1e95-4c1e-89de-877540ab51e3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:36.901584 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-95f74def-1e95-4c1e-89de-877540ab51e3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:36.902776 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-95f74def-1e95-4c1e-89de-877540ab51e3 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1731 microversion: 2.20 time: 0.194797 May 25 07:42:36.903374 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 367/703] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:36 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:42:36.908552 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-d47eab1b-bbee-4a4f-a06c-ce68e8faa25c req-eaae3060-c1bd-4d0c-bd5a-e128049b523e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ecec15-f302-4eea-92e6-37049703fa41", "name": "network-vif-plugged", "status": "completed", "tag": "28f4b108-96e9-447b-88dd-ed92dc19d98c"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:42:36.917640 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-d47eab1b-bbee-4a4f-a06c-ce68e8faa25c req-eaae3060-c1bd-4d0c-bd5a-e128049b523e service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:36.918302 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-d47eab1b-bbee-4a4f-a06c-ce68e8faa25c req-eaae3060-c1bd-4d0c-bd5a-e128049b523e service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:36.929597 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-d47eab1b-bbee-4a4f-a06c-ce68e8faa25c req-eaae3060-c1bd-4d0c-bd5a-e128049b523e service nova] Creating event network-vif-plugged:28f4b108-96e9-447b-88dd-ed92dc19d98c for instance c0ecec15-f302-4eea-92e6-37049703fa41 on hv-cinder-82549 May 25 07:42:36.935109 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-d47eab1b-bbee-4a4f-a06c-ce68e8faa25c req-eaae3060-c1bd-4d0c-bd5a-e128049b523e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029556 May 25 07:42:36.935824 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 368/704] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:42:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:42:36.947568 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-e35cab37-c19c-43c0-8ba5-ec6e261efa66 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:36.956156 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-e35cab37-c19c-43c0-8ba5-ec6e261efa66 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1568 microversion: 2.1 time: 0.180986 May 25 07:42:36.957745 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 337/705] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:36 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1568 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:37.923471 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-406435b6-beac-483b-9caf-2959494e7483 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:37.924280 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-406435b6-beac-483b-9caf-2959494e7483 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:37.930955 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-406435b6-beac-483b-9caf-2959494e7483 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:37.931470 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-406435b6-beac-483b-9caf-2959494e7483 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:37.932256 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-406435b6-beac-483b-9caf-2959494e7483 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:37.932732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-406435b6-beac-483b-9caf-2959494e7483 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:37.973814 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-10c01ff4-764c-4efc-8b23-63db870bd010 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:37.974430 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-10c01ff4-764c-4efc-8b23-63db870bd010 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:37.981003 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-10c01ff4-764c-4efc-8b23-63db870bd010 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:37.981454 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-10c01ff4-764c-4efc-8b23-63db870bd010 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:37.982698 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-10c01ff4-764c-4efc-8b23-63db870bd010 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:37.983242 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-10c01ff4-764c-4efc-8b23-63db870bd010 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:38.073084 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-406435b6-beac-483b-9caf-2959494e7483 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:38.081856 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-406435b6-beac-483b-9caf-2959494e7483 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:38.083604 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-406435b6-beac-483b-9caf-2959494e7483 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:38.084848 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-406435b6-beac-483b-9caf-2959494e7483 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1731 microversion: 2.20 time: 0.167555 May 25 07:42:38.085403 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 369/706] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:37 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1731 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:42:38.090191 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-cc691027-4ff4-4197-aed8-411001db7411 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "ae0f8e12-7130-4cdc-86cd-92b7a256d923"}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:42:38.091243 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-cc691027-4ff4-4197-aed8-411001db7411 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:38.098404 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cc691027-4ff4-4197-aed8-411001db7411 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:38.098877 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cc691027-4ff4-4197-aed8-411001db7411 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:38.099662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cc691027-4ff4-4197-aed8-411001db7411 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:38.100101 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cc691027-4ff4-4197-aed8-411001db7411 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:38.118585 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-10c01ff4-764c-4efc-8b23-63db870bd010 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:38.126300 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-10c01ff4-764c-4efc-8b23-63db870bd010 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1568 microversion: 2.1 time: 0.156363 May 25 07:42:38.126873 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 338/707] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:37 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:42:38.871703 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=4,nova_cell1:INSERT=1 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:39.103289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-5bdc29a0-13f0-482d-83d8-f95faf14861f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:39.103875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-5bdc29a0-13f0-482d-83d8-f95faf14861f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:39.110978 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5bdc29a0-13f0-482d-83d8-f95faf14861f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:39.111419 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5bdc29a0-13f0-482d-83d8-f95faf14861f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:39.112178 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5bdc29a0-13f0-482d-83d8-f95faf14861f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:39.112645 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5bdc29a0-13f0-482d-83d8-f95faf14861f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:39.245527 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-cc691027-4ff4-4197-aed8-411001db7411 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "POST /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.158808 May 25 07:42:39.246175 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 370/708] 10.222.0.24 () {60 vars in 1322 bytes} [Wed May 25 07:42:38 2022] POST /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments => generated 194 bytes in 1160 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:42:39.248314 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-5bdc29a0-13f0-482d-83d8-f95faf14861f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:39.251692 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-59bf0e37-2cd0-4ff6-bde8-d1704985f8b2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:39.252391 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-59bf0e37-2cd0-4ff6-bde8-d1704985f8b2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:39.258852 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-59bf0e37-2cd0-4ff6-bde8-d1704985f8b2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:39.259303 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-59bf0e37-2cd0-4ff6-bde8-d1704985f8b2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:39.260075 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-59bf0e37-2cd0-4ff6-bde8-d1704985f8b2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:39.260533 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-59bf0e37-2cd0-4ff6-bde8-d1704985f8b2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:39.268060 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-5bdc29a0-13f0-482d-83d8-f95faf14861f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:39.269729 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-5bdc29a0-13f0-482d-83d8-f95faf14861f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:39.271020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-5bdc29a0-13f0-482d-83d8-f95faf14861f tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1731 microversion: 2.20 time: 0.171776 May 25 07:42:39.271661 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 339/709] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:39 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1731 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:42:39.395822 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-59bf0e37-2cd0-4ff6-bde8-d1704985f8b2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:39.403075 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-59bf0e37-2cd0-4ff6-bde8-d1704985f8b2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1568 microversion: 2.1 time: 0.155786 May 25 07:42:39.403646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 371/710] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:39 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:39.564599 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-f77d8dca-6264-42c6-9087-cefbceb00b89 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1800536898", "imageRef": "ddc5b622-a846-425a-b8fd-7e5caef00bf8", "flavorRef": "452", "networks": [{"uuid": "4da000a2-13db-425e-9154-d0d501197ba8"}]}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:42:39.620371 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.network.neutron [None req-f77d8dca-6264-42c6-9087-cefbceb00b89 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] validate_networks() for [('4da000a2-13db-425e-9154-d0d501197ba8', None, None, None, None, None)] {{(pid=124674) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:42:39.974592 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-f77d8dca-6264-42c6-9087-cefbceb00b89 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Flavor limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:42:39.975017 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-f77d8dca-6264-42c6-9087-cefbceb00b89 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Image limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:42:39.975492 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-f77d8dca-6264-42c6-9087-cefbceb00b89 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Flavor pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:42:39.975902 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-f77d8dca-6264-42c6-9087-cefbceb00b89 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Image pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:42:39.976314 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-f77d8dca-6264-42c6-9087-cefbceb00b89 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:42:39.986441 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f77d8dca-6264-42c6-9087-cefbceb00b89 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:39.986896 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f77d8dca-6264-42c6-9087-cefbceb00b89 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:39.987698 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f77d8dca-6264-42c6-9087-cefbceb00b89 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:39.995981 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f77d8dca-6264-42c6-9087-cefbceb00b89 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:40.006759 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-f77d8dca-6264-42c6-9087-cefbceb00b89 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Getting quotas for project c16634316fc64493aef03cf073514273. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:42:40.011701 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-f77d8dca-6264-42c6-9087-cefbceb00b89 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Getting quotas for user c92e8b7fc090454c9498afef1d79e4bc and project c16634316fc64493aef03cf073514273. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:42:40.023281 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-f77d8dca-6264-42c6-9087-cefbceb00b89 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Going to run 1 instances... {{(pid=124674) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:42:40.025852 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-f77d8dca-6264-42c6-9087-cefbceb00b89 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: d2c1096c-18ac-4b61-bfc2-fb24367f2ce3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddc5b622-a846-425a-b8fd-7e5caef00bf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:42:40.211752 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-f77d8dca-6264-42c6-9087-cefbceb00b89 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.652350 May 25 07:42:40.217987 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 340/711] 10.222.0.24 () {60 vars in 1146 bytes} [Wed May 25 07:42:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 654 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 07:42:40.223519 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-1485cb8b-cc56-4d27-9b1b-6b158eab5786 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:40.224304 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-1485cb8b-cc56-4d27-9b1b-6b158eab5786 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: d2c1096c-18ac-4b61-bfc2-fb24367f2ce3] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:40.282823 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-1485cb8b-cc56-4d27-9b1b-6b158eab5786 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:40.290422 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-10f4514a-731a-498b-a858-7b78125e664b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:40.291320 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-10f4514a-731a-498b-a858-7b78125e664b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:40.293492 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-1485cb8b-cc56-4d27-9b1b-6b158eab5786 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3" status: 200 len: 1214 microversion: 2.1 time: 0.073952 May 25 07:42:40.295159 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 372/712] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:40 2022] GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:42:40.303401 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-10f4514a-731a-498b-a858-7b78125e664b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:40.303401 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-10f4514a-731a-498b-a858-7b78125e664b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:40.303932 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-10f4514a-731a-498b-a858-7b78125e664b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:40.304654 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-10f4514a-731a-498b-a858-7b78125e664b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:40.421031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b402bc13-f57b-4692-8eb4-e85fce8a901e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:40.421579 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b402bc13-f57b-4692-8eb4-e85fce8a901e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:40.428941 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b402bc13-f57b-4692-8eb4-e85fce8a901e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:40.429399 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b402bc13-f57b-4692-8eb4-e85fce8a901e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:40.430178 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b402bc13-f57b-4692-8eb4-e85fce8a901e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:40.430618 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b402bc13-f57b-4692-8eb4-e85fce8a901e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:40.447207 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-10f4514a-731a-498b-a858-7b78125e664b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:40.455956 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-10f4514a-731a-498b-a858-7b78125e664b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:40.457520 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-10f4514a-731a-498b-a858-7b78125e664b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:40.459331 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-10f4514a-731a-498b-a858-7b78125e664b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1731 microversion: 2.20 time: 0.172545 May 25 07:42:40.459331 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 341/713] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:40 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:42:40.563579 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b402bc13-f57b-4692-8eb4-e85fce8a901e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:40.571107 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b402bc13-f57b-4692-8eb4-e85fce8a901e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1568 microversion: 2.1 time: 0.154648 May 25 07:42:40.571671 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 373/714] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:40 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1568 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:42:41.312167 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-15d849cb-41f6-4876-a5ff-4bc017850bfb tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:41.312783 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-15d849cb-41f6-4876-a5ff-4bc017850bfb tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: d2c1096c-18ac-4b61-bfc2-fb24367f2ce3] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:41.371275 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-15d849cb-41f6-4876-a5ff-4bc017850bfb tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:41.382436 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-15d849cb-41f6-4876-a5ff-4bc017850bfb tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3" status: 200 len: 1214 microversion: 2.1 time: 0.074395 May 25 07:42:41.386888 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 342/715] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:41 2022] GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 => generated 1214 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:41.478460 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-67f7e56d-b3ca-4bcd-9855-76537e6cb85b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:41.479230 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-67f7e56d-b3ca-4bcd-9855-76537e6cb85b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:41.486625 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-67f7e56d-b3ca-4bcd-9855-76537e6cb85b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:41.487223 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-67f7e56d-b3ca-4bcd-9855-76537e6cb85b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:41.488258 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-67f7e56d-b3ca-4bcd-9855-76537e6cb85b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:41.488814 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-67f7e56d-b3ca-4bcd-9855-76537e6cb85b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:41.587335 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-2250346d-317c-4a70-a369-1fe012858359 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:41.588045 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-2250346d-317c-4a70-a369-1fe012858359 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:41.601133 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2250346d-317c-4a70-a369-1fe012858359 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:41.601691 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2250346d-317c-4a70-a369-1fe012858359 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:41.602689 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2250346d-317c-4a70-a369-1fe012858359 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:41.603224 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2250346d-317c-4a70-a369-1fe012858359 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:41.639082 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-67f7e56d-b3ca-4bcd-9855-76537e6cb85b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:41.650164 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-67f7e56d-b3ca-4bcd-9855-76537e6cb85b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:41.651929 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-67f7e56d-b3ca-4bcd-9855-76537e6cb85b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:41.653243 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-67f7e56d-b3ca-4bcd-9855-76537e6cb85b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1718 microversion: 2.20 time: 0.179763 May 25 07:42:41.653854 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 374/716] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:42:41 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1718 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:42:41.766935 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-2250346d-317c-4a70-a369-1fe012858359 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:41.774849 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-2250346d-317c-4a70-a369-1fe012858359 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1568 microversion: 2.1 time: 0.191463 May 25 07:42:41.775416 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 343/717] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:41 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:42:42.134501 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-eccdf8c5-b24f-4890-82cb-e4aae519474c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:42.135510 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-eccdf8c5-b24f-4890-82cb-e4aae519474c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:42.143760 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eccdf8c5-b24f-4890-82cb-e4aae519474c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:42.143760 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eccdf8c5-b24f-4890-82cb-e4aae519474c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:42.143760 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eccdf8c5-b24f-4890-82cb-e4aae519474c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:42.143760 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eccdf8c5-b24f-4890-82cb-e4aae519474c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:42.173641 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-eccdf8c5-b24f-4890-82cb-e4aae519474c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043431 May 25 07:42:42.174303 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 375/718] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:42:42 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:42:42.184794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-f5849882-1605-4eb3-993e-bb962ba6d8be tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:42.185296 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-f5849882-1605-4eb3-993e-bb962ba6d8be tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:42.191406 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f5849882-1605-4eb3-993e-bb962ba6d8be tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:42.191861 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f5849882-1605-4eb3-993e-bb962ba6d8be tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:42.193142 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f5849882-1605-4eb3-993e-bb962ba6d8be tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:42.193240 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f5849882-1605-4eb3-993e-bb962ba6d8be tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:42.222821 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-f5849882-1605-4eb3-993e-bb962ba6d8be tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments/69f6a2c9-ad9e-4255-bca9-5e0d8e29867f" status: 200 len: 194 microversion: 2.1 time: 0.042067 May 25 07:42:42.223408 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 344/719] 10.222.0.24 () {58 vars in 1412 bytes} [Wed May 25 07:42:42 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments/69f6a2c9-ad9e-4255-bca9-5e0d8e29867f => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:42:42.401333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-7fb40353-cb7f-4653-a767-a15d4f6c46c8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:42.401879 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-7fb40353-cb7f-4653-a767-a15d4f6c46c8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: d2c1096c-18ac-4b61-bfc2-fb24367f2ce3] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:42.410144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7fb40353-cb7f-4653-a767-a15d4f6c46c8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:42.410609 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7fb40353-cb7f-4653-a767-a15d4f6c46c8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:42.411527 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7fb40353-cb7f-4653-a767-a15d4f6c46c8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:42.411978 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7fb40353-cb7f-4653-a767-a15d4f6c46c8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:42.477938 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-7fb40353-cb7f-4653-a767-a15d4f6c46c8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:42.486029 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-7fb40353-cb7f-4653-a767-a15d4f6c46c8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3" status: 200 len: 1266 microversion: 2.1 time: 0.089267 May 25 07:42:42.486583 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 376/720] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:42 2022] GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:42.791427 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-9b38ea1a-f7c3-4ec2-a8d5-0f22f411b81c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:42.792646 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-9b38ea1a-f7c3-4ec2-a8d5-0f22f411b81c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:42.799613 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9b38ea1a-f7c3-4ec2-a8d5-0f22f411b81c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:42.800066 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9b38ea1a-f7c3-4ec2-a8d5-0f22f411b81c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:42.800872 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9b38ea1a-f7c3-4ec2-a8d5-0f22f411b81c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:42.801374 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9b38ea1a-f7c3-4ec2-a8d5-0f22f411b81c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:43.062718 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9b38ea1a-f7c3-4ec2-a8d5-0f22f411b81c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:43.081625 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-9b38ea1a-f7c3-4ec2-a8d5-0f22f411b81c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1568 microversion: 2.1 time: 0.294078 May 25 07:42:43.082450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 345/721] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:42 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1568 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:42:43.504039 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-2c8643d4-dd1e-45a4-9241-224458fe4056 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:43.504850 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-2c8643d4-dd1e-45a4-9241-224458fe4056 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: d2c1096c-18ac-4b61-bfc2-fb24367f2ce3] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:43.511522 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2c8643d4-dd1e-45a4-9241-224458fe4056 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:43.511984 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2c8643d4-dd1e-45a4-9241-224458fe4056 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:43.512810 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2c8643d4-dd1e-45a4-9241-224458fe4056 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:43.513289 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2c8643d4-dd1e-45a4-9241-224458fe4056 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:43.579436 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-2c8643d4-dd1e-45a4-9241-224458fe4056 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:43.587587 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-2c8643d4-dd1e-45a4-9241-224458fe4056 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3" status: 200 len: 1272 microversion: 2.1 time: 0.087509 May 25 07:42:43.588417 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 377/722] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:43 2022] GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 => generated 1272 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:43.985065 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-8a90cb0b-7fa5-4580-bb5f-0929796c6c1a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09cdd005-0243-42bc-bb9c-5adb2b354fb8"}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:42:43.986139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-8a90cb0b-7fa5-4580-bb5f-0929796c6c1a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:43.992944 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8a90cb0b-7fa5-4580-bb5f-0929796c6c1a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:43.993395 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8a90cb0b-7fa5-4580-bb5f-0929796c6c1a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:43.994174 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8a90cb0b-7fa5-4580-bb5f-0929796c6c1a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:43.994604 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8a90cb0b-7fa5-4580-bb5f-0929796c6c1a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:44.098931 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-faf93f17-5cd8-4477-be5e-92a484252dc3 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:44.099589 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-faf93f17-5cd8-4477-be5e-92a484252dc3 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:44.105565 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-faf93f17-5cd8-4477-be5e-92a484252dc3 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:44.106019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-faf93f17-5cd8-4477-be5e-92a484252dc3 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:44.106788 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-faf93f17-5cd8-4477-be5e-92a484252dc3 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:44.107234 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-faf93f17-5cd8-4477-be5e-92a484252dc3 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:44.238791 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-faf93f17-5cd8-4477-be5e-92a484252dc3 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:44.246380 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-faf93f17-5cd8-4477-be5e-92a484252dc3 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1568 microversion: 2.1 time: 0.151406 May 25 07:42:44.246947 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 378/723] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:44 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:42:44.608782 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-cc06f5b8-095d-4a2d-885e-99cfa5e2fc95 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:44.609404 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-cc06f5b8-095d-4a2d-885e-99cfa5e2fc95 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: d2c1096c-18ac-4b61-bfc2-fb24367f2ce3] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:44.616107 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cc06f5b8-095d-4a2d-885e-99cfa5e2fc95 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:44.616602 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cc06f5b8-095d-4a2d-885e-99cfa5e2fc95 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:44.617379 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cc06f5b8-095d-4a2d-885e-99cfa5e2fc95 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:44.617825 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cc06f5b8-095d-4a2d-885e-99cfa5e2fc95 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:44.747383 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-cc06f5b8-095d-4a2d-885e-99cfa5e2fc95 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:44.755696 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-cc06f5b8-095d-4a2d-885e-99cfa5e2fc95 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3" status: 200 len: 1314 microversion: 2.1 time: 0.150879 May 25 07:42:44.756264 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 379/724] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:44 2022] GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:42:45.263690 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-589f7f16-1569-4494-a005-f63a8781147e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:45.264337 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-589f7f16-1569-4494-a005-f63a8781147e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:45.271105 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-589f7f16-1569-4494-a005-f63a8781147e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:45.271560 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-589f7f16-1569-4494-a005-f63a8781147e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:45.272327 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-589f7f16-1569-4494-a005-f63a8781147e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:45.272790 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-589f7f16-1569-4494-a005-f63a8781147e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:45.429378 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-589f7f16-1569-4494-a005-f63a8781147e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:45.436909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-589f7f16-1569-4494-a005-f63a8781147e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1568 microversion: 2.1 time: 0.177398 May 25 07:42:45.437473 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 380/725] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:45 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1568 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:45.850600 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-8a90cb0b-7fa5-4580-bb5f-0929796c6c1a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "POST /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.869424 May 25 07:42:45.851377 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 346/726] 10.222.0.24 () {60 vars in 1322 bytes} [Wed May 25 07:42:43 2022] POST /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments => generated 194 bytes in 1871 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:42:45.856458 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-a5e37953-836d-4674-8e72-8304cd14cd92 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:45.857177 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-a5e37953-836d-4674-8e72-8304cd14cd92 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: d2c1096c-18ac-4b61-bfc2-fb24367f2ce3] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:45.873626 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a5e37953-836d-4674-8e72-8304cd14cd92 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:45.874393 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a5e37953-836d-4674-8e72-8304cd14cd92 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:45.875348 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a5e37953-836d-4674-8e72-8304cd14cd92 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:45.875934 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-a5e37953-836d-4674-8e72-8304cd14cd92 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:45.922448 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-f725efac-7f6d-48d3-8e15-7d2b46ed8ac6 req-d59825d8-9e8e-429c-b247-54f493c356bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d2c1096c-18ac-4b61-bfc2-fb24367f2ce3", "tag": "99509c55-57ba-437e-ad14-129aa1ea57fc"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:42:45.930731 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-f725efac-7f6d-48d3-8e15-7d2b46ed8ac6 req-d59825d8-9e8e-429c-b247-54f493c356bf service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:45.931405 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-f725efac-7f6d-48d3-8e15-7d2b46ed8ac6 req-d59825d8-9e8e-429c-b247-54f493c356bf service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:45.943665 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-f725efac-7f6d-48d3-8e15-7d2b46ed8ac6 req-d59825d8-9e8e-429c-b247-54f493c356bf service nova] Creating event network-changed:99509c55-57ba-437e-ad14-129aa1ea57fc for instance d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 on hv-cinder-82549 May 25 07:42:45.948464 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-f725efac-7f6d-48d3-8e15-7d2b46ed8ac6 req-d59825d8-9e8e-429c-b247-54f493c356bf service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.185742 May 25 07:42:45.953075 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 381/727] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:42:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:42:46.114488 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-a5e37953-836d-4674-8e72-8304cd14cd92 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:46.121939 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-a5e37953-836d-4674-8e72-8304cd14cd92 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3" status: 200 len: 1314 microversion: 2.1 time: 0.269310 May 25 07:42:46.122519 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 347/728] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:45 2022] GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 => generated 1314 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:46.454513 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-9503a285-6e4d-4e98-bbcb-f32a1d2c7b95 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:46.455210 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-9503a285-6e4d-4e98-bbcb-f32a1d2c7b95 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:46.461399 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9503a285-6e4d-4e98-bbcb-f32a1d2c7b95 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:46.461854 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9503a285-6e4d-4e98-bbcb-f32a1d2c7b95 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:46.462616 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9503a285-6e4d-4e98-bbcb-f32a1d2c7b95 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:46.463053 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9503a285-6e4d-4e98-bbcb-f32a1d2c7b95 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:46.595074 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-9503a285-6e4d-4e98-bbcb-f32a1d2c7b95 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:46.602699 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-9503a285-6e4d-4e98-bbcb-f32a1d2c7b95 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1569 microversion: 2.1 time: 0.152576 May 25 07:42:46.603257 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 382/729] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:46 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:46.619685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-296269bf-2130-4c61-8b2a-69d2555e2fd1 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:42:46.620250 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-296269bf-2130-4c61-8b2a-69d2555e2fd1 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:46.626782 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-296269bf-2130-4c61-8b2a-69d2555e2fd1 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:46.627224 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-296269bf-2130-4c61-8b2a-69d2555e2fd1 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:46.627978 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-296269bf-2130-4c61-8b2a-69d2555e2fd1 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:46.628411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-296269bf-2130-4c61-8b2a-69d2555e2fd1 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:46.888835 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-296269bf-2130-4c61-8b2a-69d2555e2fd1 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "POST /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91/action" status: 202 len: 0 microversion: 2.1 time: 0.272830 May 25 07:42:46.889480 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 348/730] 10.222.0.24 () {60 vars in 1277 bytes} [Wed May 25 07:42:46 2022] POST /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91/action => generated 0 bytes in 274 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:42:46.897790 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-9e7fbc3e-151b-4b66-b689-fb036f2ff0dd tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:46.898453 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-9e7fbc3e-151b-4b66-b689-fb036f2ff0dd tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:46.905557 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9e7fbc3e-151b-4b66-b689-fb036f2ff0dd tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:46.906018 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9e7fbc3e-151b-4b66-b689-fb036f2ff0dd tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:46.906797 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9e7fbc3e-151b-4b66-b689-fb036f2ff0dd tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:46.907254 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9e7fbc3e-151b-4b66-b689-fb036f2ff0dd tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:47.075014 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-9e7fbc3e-151b-4b66-b689-fb036f2ff0dd tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:47.083635 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-9e7fbc3e-151b-4b66-b689-fb036f2ff0dd tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1577 microversion: 2.1 time: 0.189852 May 25 07:42:47.084798 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 383/731] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:46 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1577 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:47.140097 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-b4b5edea-f0e1-49f5-aa51-fff0f0586b7b tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:47.140661 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-b4b5edea-f0e1-49f5-aa51-fff0f0586b7b tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: d2c1096c-18ac-4b61-bfc2-fb24367f2ce3] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:47.146647 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b4b5edea-f0e1-49f5-aa51-fff0f0586b7b tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:47.147103 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b4b5edea-f0e1-49f5-aa51-fff0f0586b7b tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:47.147878 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b4b5edea-f0e1-49f5-aa51-fff0f0586b7b tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:47.148315 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b4b5edea-f0e1-49f5-aa51-fff0f0586b7b tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:47.168797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=5,nova_cell1:INSERT=3 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:47.317888 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-b4b5edea-f0e1-49f5-aa51-fff0f0586b7b tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:47.325307 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-b4b5edea-f0e1-49f5-aa51-fff0f0586b7b tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3" status: 200 len: 1314 microversion: 2.1 time: 0.189981 May 25 07:42:47.325887 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 349/732] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:47 2022] GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:48.101809 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-116955b1-d08e-4966-86a7-035360a6c94e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:48.102626 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-116955b1-d08e-4966-86a7-035360a6c94e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:48.110813 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-116955b1-d08e-4966-86a7-035360a6c94e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:48.111391 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-116955b1-d08e-4966-86a7-035360a6c94e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:48.112325 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-116955b1-d08e-4966-86a7-035360a6c94e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:48.112934 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-116955b1-d08e-4966-86a7-035360a6c94e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:48.255312 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-116955b1-d08e-4966-86a7-035360a6c94e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:48.263214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-116955b1-d08e-4966-86a7-035360a6c94e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1517 microversion: 2.1 time: 0.165475 May 25 07:42:48.263955 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 384/733] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:48 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1517 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:42:48.343908 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-cd5302b0-1c22-403c-b46c-4a122c53a1b2 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:48.344435 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-cd5302b0-1c22-403c-b46c-4a122c53a1b2 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: d2c1096c-18ac-4b61-bfc2-fb24367f2ce3] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:48.351517 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cd5302b0-1c22-403c-b46c-4a122c53a1b2 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:48.351959 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cd5302b0-1c22-403c-b46c-4a122c53a1b2 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:48.352741 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cd5302b0-1c22-403c-b46c-4a122c53a1b2 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:48.353174 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cd5302b0-1c22-403c-b46c-4a122c53a1b2 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:48.484403 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-cd5302b0-1c22-403c-b46c-4a122c53a1b2 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:48.492136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-cd5302b0-1c22-403c-b46c-4a122c53a1b2 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3" status: 200 len: 1314 microversion: 2.1 time: 0.152714 May 25 07:42:48.492797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 350/734] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:48 2022] GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:42:49.083961 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-c44f0752-f01a-4abf-b24a-dfc8373a0dc2 req-c43d8c84-62da-4aa4-8224-e29f29ab24a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63430b83-f298-430c-9ca9-bdd4d69bde91", "name": "network-vif-unplugged", "status": "completed", "tag": "6d5abc91-52ce-441e-be4e-749082dec7ae"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:42:49.087643 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=78 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:49.094515 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-c44f0752-f01a-4abf-b24a-dfc8373a0dc2 req-c43d8c84-62da-4aa4-8224-e29f29ab24a1 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:49.095054 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-c44f0752-f01a-4abf-b24a-dfc8373a0dc2 req-c43d8c84-62da-4aa4-8224-e29f29ab24a1 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:49.109822 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.compute.server_external_events [req-c44f0752-f01a-4abf-b24a-dfc8373a0dc2 req-c43d8c84-62da-4aa4-8224-e29f29ab24a1 service nova] Unable to find a host for instance 63430b83-f298-430c-9ca9-bdd4d69bde91. Dropping event network-vif-unplugged {{(pid=124675) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} May 25 07:42:49.118420 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-c44f0752-f01a-4abf-b24a-dfc8373a0dc2 req-c43d8c84-62da-4aa4-8224-e29f29ab24a1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.030553 May 25 07:42:49.119387 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 385/735] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:42:49 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 40 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) May 25 07:42:49.281356 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7670d4ee-c61c-49e1-b168-811e83e4e93f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:49.281967 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-7670d4ee-c61c-49e1-b168-811e83e4e93f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:49.287891 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7670d4ee-c61c-49e1-b168-811e83e4e93f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:49.290559 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7670d4ee-c61c-49e1-b168-811e83e4e93f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:49.290559 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7670d4ee-c61c-49e1-b168-811e83e4e93f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:49.290559 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7670d4ee-c61c-49e1-b168-811e83e4e93f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:49.418566 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7670d4ee-c61c-49e1-b168-811e83e4e93f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:49.426539 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-7670d4ee-c61c-49e1-b168-811e83e4e93f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1519 microversion: 2.1 time: 0.149727 May 25 07:42:49.427102 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 351/736] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:49 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:49.509599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-1e22704d-dbeb-44fe-aa05-3ca22c1c2280 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:49.510222 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-1e22704d-dbeb-44fe-aa05-3ca22c1c2280 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: d2c1096c-18ac-4b61-bfc2-fb24367f2ce3] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:49.517423 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1e22704d-dbeb-44fe-aa05-3ca22c1c2280 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:49.517870 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1e22704d-dbeb-44fe-aa05-3ca22c1c2280 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:49.518718 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1e22704d-dbeb-44fe-aa05-3ca22c1c2280 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:49.519163 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1e22704d-dbeb-44fe-aa05-3ca22c1c2280 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:49.651434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-1e22704d-dbeb-44fe-aa05-3ca22c1c2280 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:49.659076 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-1e22704d-dbeb-44fe-aa05-3ca22c1c2280 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3" status: 200 len: 1314 microversion: 2.1 time: 0.153682 May 25 07:42:49.659763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 386/737] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:49 2022] GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:50.123906 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c0e1d8f0-6c52-4374-9c13-d93af2955353 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:50.124410 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c0e1d8f0-6c52-4374-9c13-d93af2955353 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:50.126269 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=2 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:50.131119 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c0e1d8f0-6c52-4374-9c13-d93af2955353 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:50.137316 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c0e1d8f0-6c52-4374-9c13-d93af2955353 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:50.137316 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c0e1d8f0-6c52-4374-9c13-d93af2955353 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:50.137316 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c0e1d8f0-6c52-4374-9c13-d93af2955353 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:50.213674 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.objects.instance [None req-c0e1d8f0-6c52-4374-9c13-d93af2955353 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lazy-loading 'services' on Instance uuid e1792da3-df94-4a97-9f39-a2200abfad07 {{(pid=124674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:42:50.444275 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-d9b121f5-aa68-4f06-a9f6-14f6101414de tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:50.444927 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-d9b121f5-aa68-4f06-a9f6-14f6101414de tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:50.452562 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=2 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:50.458066 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d9b121f5-aa68-4f06-a9f6-14f6101414de tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:50.458066 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d9b121f5-aa68-4f06-a9f6-14f6101414de tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:50.458306 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c0e1d8f0-6c52-4374-9c13-d93af2955353 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "DELETE /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments/ae0f8e12-7130-4cdc-86cd-92b7a256d923" status: 202 len: 0 microversion: 2.1 time: 0.335691 May 25 07:42:50.458745 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d9b121f5-aa68-4f06-a9f6-14f6101414de tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:50.458843 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 352/738] 10.222.0.24 () {58 vars in 1415 bytes} [Wed May 25 07:42:50 2022] DELETE /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments/ae0f8e12-7130-4cdc-86cd-92b7a256d923 => generated 0 bytes in 337 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:42:50.459712 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d9b121f5-aa68-4f06-a9f6-14f6101414de tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:50.466021 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-e0d85c9e-0919-4ec0-af5b-a314bff8e4ea tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:50.467106 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-e0d85c9e-0919-4ec0-af5b-a314bff8e4ea tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:50.473786 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e0d85c9e-0919-4ec0-af5b-a314bff8e4ea tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:50.474440 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e0d85c9e-0919-4ec0-af5b-a314bff8e4ea tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:50.475240 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e0d85c9e-0919-4ec0-af5b-a314bff8e4ea tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:50.475741 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e0d85c9e-0919-4ec0-af5b-a314bff8e4ea tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:50.508039 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-e0d85c9e-0919-4ec0-af5b-a314bff8e4ea tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047520 May 25 07:42:50.508648 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 353/739] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:42:50 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:42:50.602524 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-d9b121f5-aa68-4f06-a9f6-14f6101414de tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:50.612881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-d9b121f5-aa68-4f06-a9f6-14f6101414de tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1519 microversion: 2.1 time: 0.172725 May 25 07:42:50.614286 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 387/740] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:50 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1519 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:42:50.675789 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-437be7fe-9957-4979-adaa-e9f06e34d9b9 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:50.676401 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-437be7fe-9957-4979-adaa-e9f06e34d9b9 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: d2c1096c-18ac-4b61-bfc2-fb24367f2ce3] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:50.682625 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-437be7fe-9957-4979-adaa-e9f06e34d9b9 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:50.683068 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-437be7fe-9957-4979-adaa-e9f06e34d9b9 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:50.683818 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-437be7fe-9957-4979-adaa-e9f06e34d9b9 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:50.684247 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-437be7fe-9957-4979-adaa-e9f06e34d9b9 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:50.812437 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-437be7fe-9957-4979-adaa-e9f06e34d9b9 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:50.819887 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-437be7fe-9957-4979-adaa-e9f06e34d9b9 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3" status: 200 len: 1314 microversion: 2.1 time: 0.147952 May 25 07:42:50.820455 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 354/741] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:50 2022] GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:42:51.133340 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-10fb8c94-8f87-415d-acaa-a9eb7e7c3c5e req-32ac345b-94d0-433b-a5dc-51744240ec2e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c1096c-18ac-4b61-bfc2-fb24367f2ce3", "name": "network-vif-plugged", "status": "completed", "tag": "99509c55-57ba-437e-ad14-129aa1ea57fc"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:42:51.142144 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-10fb8c94-8f87-415d-acaa-a9eb7e7c3c5e req-32ac345b-94d0-433b-a5dc-51744240ec2e service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:51.142647 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-10fb8c94-8f87-415d-acaa-a9eb7e7c3c5e req-32ac345b-94d0-433b-a5dc-51744240ec2e service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:51.153881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-10fb8c94-8f87-415d-acaa-a9eb7e7c3c5e req-32ac345b-94d0-433b-a5dc-51744240ec2e service nova] Creating event network-vif-plugged:99509c55-57ba-437e-ad14-129aa1ea57fc for instance d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 on hv-cinder-82549 May 25 07:42:51.158906 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-10fb8c94-8f87-415d-acaa-a9eb7e7c3c5e req-32ac345b-94d0-433b-a5dc-51744240ec2e service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029228 May 25 07:42:51.159497 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 388/742] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:42:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:42:51.519693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-6f6d165d-44cd-4852-87cc-a03cb7cbd566 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:51.520763 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-6f6d165d-44cd-4852-87cc-a03cb7cbd566 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:51.523236 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=8 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:51.528201 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6f6d165d-44cd-4852-87cc-a03cb7cbd566 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:51.528686 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6f6d165d-44cd-4852-87cc-a03cb7cbd566 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:51.529788 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6f6d165d-44cd-4852-87cc-a03cb7cbd566 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:51.530259 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6f6d165d-44cd-4852-87cc-a03cb7cbd566 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:51.561302 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-6f6d165d-44cd-4852-87cc-a03cb7cbd566 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044879 May 25 07:42:51.562250 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 355/743] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:42:51 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:42:51.633735 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4900f39b-fcd3-47b9-8ede-4410aab48179 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:51.634369 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4900f39b-fcd3-47b9-8ede-4410aab48179 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:51.640607 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4900f39b-fcd3-47b9-8ede-4410aab48179 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:51.641061 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4900f39b-fcd3-47b9-8ede-4410aab48179 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:51.641830 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4900f39b-fcd3-47b9-8ede-4410aab48179 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:51.642272 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4900f39b-fcd3-47b9-8ede-4410aab48179 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:51.774961 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4900f39b-fcd3-47b9-8ede-4410aab48179 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:51.782983 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4900f39b-fcd3-47b9-8ede-4410aab48179 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1519 microversion: 2.1 time: 0.154148 May 25 07:42:51.783585 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 389/744] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:51 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1519 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:51.837285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-0e5e1fe6-f73c-44c8-91a7-9a798d1cdce8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:51.837902 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-0e5e1fe6-f73c-44c8-91a7-9a798d1cdce8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: d2c1096c-18ac-4b61-bfc2-fb24367f2ce3] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:51.844849 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0e5e1fe6-f73c-44c8-91a7-9a798d1cdce8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:51.845298 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0e5e1fe6-f73c-44c8-91a7-9a798d1cdce8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:51.846098 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0e5e1fe6-f73c-44c8-91a7-9a798d1cdce8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:51.846535 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0e5e1fe6-f73c-44c8-91a7-9a798d1cdce8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:51.971883 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-0e5e1fe6-f73c-44c8-91a7-9a798d1cdce8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:51.979346 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-0e5e1fe6-f73c-44c8-91a7-9a798d1cdce8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3" status: 200 len: 1314 microversion: 2.1 time: 0.145921 May 25 07:42:51.979915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 356/745] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:51 2022] GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 => generated 1314 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:52.573310 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-dc9544d3-4735-4de1-abf4-0e6b5880a3a3 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:52.574256 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-dc9544d3-4735-4de1-abf4-0e6b5880a3a3 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:52.580957 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dc9544d3-4735-4de1-abf4-0e6b5880a3a3 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:52.581416 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dc9544d3-4735-4de1-abf4-0e6b5880a3a3 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:52.582195 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dc9544d3-4735-4de1-abf4-0e6b5880a3a3 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:52.582643 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dc9544d3-4735-4de1-abf4-0e6b5880a3a3 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:52.585177 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:52.615319 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-dc9544d3-4735-4de1-abf4-0e6b5880a3a3 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046125 May 25 07:42:52.615887 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 390/746] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:42:52 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:42:52.799320 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-57cb8a6d-4151-4747-8903-208fe244848c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:52.800050 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-57cb8a6d-4151-4747-8903-208fe244848c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:52.806534 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-57cb8a6d-4151-4747-8903-208fe244848c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:52.806984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-57cb8a6d-4151-4747-8903-208fe244848c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:52.807772 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-57cb8a6d-4151-4747-8903-208fe244848c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:52.808205 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-57cb8a6d-4151-4747-8903-208fe244848c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:52.944903 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-57cb8a6d-4151-4747-8903-208fe244848c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:52.952693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-57cb8a6d-4151-4747-8903-208fe244848c tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1519 microversion: 2.1 time: 0.157331 May 25 07:42:52.953260 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 357/747] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:52 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1519 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:42:52.997351 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a6cda295-c4e5-4049-93b3-868f20ae8f0c tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:52.998738 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a6cda295-c4e5-4049-93b3-868f20ae8f0c tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: d2c1096c-18ac-4b61-bfc2-fb24367f2ce3] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:53.005977 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a6cda295-c4e5-4049-93b3-868f20ae8f0c tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:53.006442 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a6cda295-c4e5-4049-93b3-868f20ae8f0c tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:53.007210 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a6cda295-c4e5-4049-93b3-868f20ae8f0c tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:53.007685 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a6cda295-c4e5-4049-93b3-868f20ae8f0c tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:53.143008 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a6cda295-c4e5-4049-93b3-868f20ae8f0c tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:53.150484 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a6cda295-c4e5-4049-93b3-868f20ae8f0c tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3" status: 200 len: 1497 microversion: 2.1 time: 0.157392 May 25 07:42:53.153846 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 391/748] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:52 2022] GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 => generated 1497 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:53.627401 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-50e9e624-4a6f-45ff-b9a2-9b6f02f40668 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:53.628376 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-50e9e624-4a6f-45ff-b9a2-9b6f02f40668 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:53.634529 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-50e9e624-4a6f-45ff-b9a2-9b6f02f40668 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:53.634975 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-50e9e624-4a6f-45ff-b9a2-9b6f02f40668 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:53.638298 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-50e9e624-4a6f-45ff-b9a2-9b6f02f40668 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:53.638298 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-50e9e624-4a6f-45ff-b9a2-9b6f02f40668 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:53.671576 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-50e9e624-4a6f-45ff-b9a2-9b6f02f40668 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043224 May 25 07:42:53.671576 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 358/749] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:42:53 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:42:53.970755 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-6c3b49a8-7f0e-4dcd-bae9-ea583f1c2086 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:53.971372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-6c3b49a8-7f0e-4dcd-bae9-ea583f1c2086 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:53.977512 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6c3b49a8-7f0e-4dcd-bae9-ea583f1c2086 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:53.977984 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6c3b49a8-7f0e-4dcd-bae9-ea583f1c2086 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:53.978744 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6c3b49a8-7f0e-4dcd-bae9-ea583f1c2086 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:53.979182 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6c3b49a8-7f0e-4dcd-bae9-ea583f1c2086 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:54.118983 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-6c3b49a8-7f0e-4dcd-bae9-ea583f1c2086 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:54.128106 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-6c3b49a8-7f0e-4dcd-bae9-ea583f1c2086 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1519 microversion: 2.1 time: 0.162182 May 25 07:42:54.128708 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 392/750] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:53 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1519 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:54.152603 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-08943d50-90a2-4210-a7cb-f2265708d2ff tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:54.153085 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-08943d50-90a2-4210-a7cb-f2265708d2ff tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: d2c1096c-18ac-4b61-bfc2-fb24367f2ce3] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:54.159704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-08943d50-90a2-4210-a7cb-f2265708d2ff tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:54.160152 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-08943d50-90a2-4210-a7cb-f2265708d2ff tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:54.168958 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-08943d50-90a2-4210-a7cb-f2265708d2ff tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:54.168958 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-08943d50-90a2-4210-a7cb-f2265708d2ff tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:54.186291 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-08943d50-90a2-4210-a7cb-f2265708d2ff tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: d2c1096c-18ac-4b61-bfc2-fb24367f2ce3] Going to try to terminate instance {{(pid=124674) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:42:54.489259 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-08943d50-90a2-4210-a7cb-f2265708d2ff tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "DELETE /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3" status: 204 len: 0 microversion: 2.1 time: 0.339767 May 25 07:42:54.489867 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 359/751] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:42:54 2022] DELETE /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 07:42:54.498881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-5af35f50-3feb-4e20-abf0-555482987f31 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:54.499507 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-5af35f50-3feb-4e20-abf0-555482987f31 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: d2c1096c-18ac-4b61-bfc2-fb24367f2ce3] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:54.505526 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5af35f50-3feb-4e20-abf0-555482987f31 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:54.506006 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5af35f50-3feb-4e20-abf0-555482987f31 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:54.506807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5af35f50-3feb-4e20-abf0-555482987f31 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:54.507250 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5af35f50-3feb-4e20-abf0-555482987f31 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:54.637837 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-5af35f50-3feb-4e20-abf0-555482987f31 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:54.645964 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-5af35f50-3feb-4e20-abf0-555482987f31 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3" status: 200 len: 1503 microversion: 2.1 time: 0.151745 May 25 07:42:54.646534 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 393/752] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:54 2022] GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 => generated 1503 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:42:54.680865 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-465e2f92-25d9-44ee-b291-7eb9d48337db tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:54.681883 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-465e2f92-25d9-44ee-b291-7eb9d48337db tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:54.688272 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-465e2f92-25d9-44ee-b291-7eb9d48337db tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:54.688763 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-465e2f92-25d9-44ee-b291-7eb9d48337db tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:54.689533 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-465e2f92-25d9-44ee-b291-7eb9d48337db tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:54.689979 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-465e2f92-25d9-44ee-b291-7eb9d48337db tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:54.719880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-465e2f92-25d9-44ee-b291-7eb9d48337db tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043323 May 25 07:42:54.720360 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 360/753] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:42:54 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:42:55.145757 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-646c65f6-4a3c-4887-89c8-ffcc2a24d6e5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:55.146300 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-646c65f6-4a3c-4887-89c8-ffcc2a24d6e5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:55.152970 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-646c65f6-4a3c-4887-89c8-ffcc2a24d6e5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:55.153427 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-646c65f6-4a3c-4887-89c8-ffcc2a24d6e5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:55.154200 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-646c65f6-4a3c-4887-89c8-ffcc2a24d6e5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:55.154709 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-646c65f6-4a3c-4887-89c8-ffcc2a24d6e5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:55.284403 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-646c65f6-4a3c-4887-89c8-ffcc2a24d6e5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:55.291967 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-646c65f6-4a3c-4887-89c8-ffcc2a24d6e5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1519 microversion: 2.1 time: 0.150222 May 25 07:42:55.292561 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 394/754] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:55 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1519 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:55.663843 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-8c13a39b-f55a-4968-8d4d-dcc1ee6c194d tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:55.664457 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-8c13a39b-f55a-4968-8d4d-dcc1ee6c194d tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: d2c1096c-18ac-4b61-bfc2-fb24367f2ce3] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:55.671058 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8c13a39b-f55a-4968-8d4d-dcc1ee6c194d tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:55.671508 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8c13a39b-f55a-4968-8d4d-dcc1ee6c194d tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:55.672270 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8c13a39b-f55a-4968-8d4d-dcc1ee6c194d tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:55.672737 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8c13a39b-f55a-4968-8d4d-dcc1ee6c194d tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:55.731450 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-efe1970c-cb8b-406e-ad55-76274f0f5f65 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:55.732612 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-efe1970c-cb8b-406e-ad55-76274f0f5f65 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:55.739089 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-efe1970c-cb8b-406e-ad55-76274f0f5f65 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:55.739542 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-efe1970c-cb8b-406e-ad55-76274f0f5f65 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:55.740326 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-efe1970c-cb8b-406e-ad55-76274f0f5f65 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:55.740806 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-efe1970c-cb8b-406e-ad55-76274f0f5f65 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:55.771408 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-efe1970c-cb8b-406e-ad55-76274f0f5f65 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043881 May 25 07:42:55.771892 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 395/755] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:42:55 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:42:55.800857 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-8c13a39b-f55a-4968-8d4d-dcc1ee6c194d tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:55.808257 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-8c13a39b-f55a-4968-8d4d-dcc1ee6c194d tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3" status: 200 len: 1503 microversion: 2.1 time: 0.148244 May 25 07:42:55.808863 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 361/756] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:55 2022] GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 => generated 1503 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:56.310087 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-0340bc90-4b75-4225-b75e-b3d364ac3efe tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:56.311234 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-0340bc90-4b75-4225-b75e-b3d364ac3efe tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:56.317782 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0340bc90-4b75-4225-b75e-b3d364ac3efe tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:56.318234 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0340bc90-4b75-4225-b75e-b3d364ac3efe tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:56.319002 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0340bc90-4b75-4225-b75e-b3d364ac3efe tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:56.319437 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0340bc90-4b75-4225-b75e-b3d364ac3efe tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:56.456547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-0340bc90-4b75-4225-b75e-b3d364ac3efe tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:56.464280 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-0340bc90-4b75-4225-b75e-b3d364ac3efe tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1519 microversion: 2.1 time: 0.158250 May 25 07:42:56.470248 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 396/757] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:56 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1519 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:42:56.783649 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-ff5d76f4-6e8d-4dbb-b1f6-f64618c345d6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:56.784722 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-ff5d76f4-6e8d-4dbb-b1f6-f64618c345d6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:56.791427 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ff5d76f4-6e8d-4dbb-b1f6-f64618c345d6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:56.791953 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ff5d76f4-6e8d-4dbb-b1f6-f64618c345d6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:56.792824 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ff5d76f4-6e8d-4dbb-b1f6-f64618c345d6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:56.793261 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ff5d76f4-6e8d-4dbb-b1f6-f64618c345d6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:56.806666 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-445aeba7-8450-4fa0-9850-5a0a8ef3d74e req-db20a078-a609-47bf-af13-7f54441ee93c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d2c1096c-18ac-4b61-bfc2-fb24367f2ce3", "name": "network-vif-deleted", "tag": "99509c55-57ba-437e-ad14-129aa1ea57fc"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:42:56.814499 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-445aeba7-8450-4fa0-9850-5a0a8ef3d74e req-db20a078-a609-47bf-af13-7f54441ee93c service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:56.814940 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-445aeba7-8450-4fa0-9850-5a0a8ef3d74e req-db20a078-a609-47bf-af13-7f54441ee93c service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:56.826869 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-445aeba7-8450-4fa0-9850-5a0a8ef3d74e req-db20a078-a609-47bf-af13-7f54441ee93c service nova] Creating event network-vif-deleted:99509c55-57ba-437e-ad14-129aa1ea57fc for instance d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 on hv-cinder-82549 May 25 07:42:56.827049 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-ff5d76f4-6e8d-4dbb-b1f6-f64618c345d6 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047319 May 25 07:42:56.827648 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 362/758] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:42:56 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:42:56.832153 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-4bd51ed3-cee4-4b28-8897-4c9eca610fd1 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:56.832783 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-4bd51ed3-cee4-4b28-8897-4c9eca610fd1 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: d2c1096c-18ac-4b61-bfc2-fb24367f2ce3] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:56.833892 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-445aeba7-8450-4fa0-9850-5a0a8ef3d74e req-db20a078-a609-47bf-af13-7f54441ee93c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030778 May 25 07:42:56.834497 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 397/759] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:42:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:42:56.838758 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4bd51ed3-cee4-4b28-8897-4c9eca610fd1 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:56.839201 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4bd51ed3-cee4-4b28-8897-4c9eca610fd1 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:56.839959 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4bd51ed3-cee4-4b28-8897-4c9eca610fd1 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:56.840395 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4bd51ed3-cee4-4b28-8897-4c9eca610fd1 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:56.904938 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-4bd51ed3-cee4-4b28-8897-4c9eca610fd1 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:56.908403 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:42:56.912757 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-4bd51ed3-cee4-4b28-8897-4c9eca610fd1 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3" status: 200 len: 1461 microversion: 2.1 time: 0.084046 May 25 07:42:56.913846 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 363/760] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:56 2022] GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 => generated 1461 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:57.483993 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-0ae41012-b75f-4eda-9ba4-4362ceb37fc5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:57.484721 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-0ae41012-b75f-4eda-9ba4-4362ceb37fc5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:57.491245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0ae41012-b75f-4eda-9ba4-4362ceb37fc5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:57.495344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0ae41012-b75f-4eda-9ba4-4362ceb37fc5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:57.495344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0ae41012-b75f-4eda-9ba4-4362ceb37fc5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:57.495344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0ae41012-b75f-4eda-9ba4-4362ceb37fc5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:57.636448 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-0ae41012-b75f-4eda-9ba4-4362ceb37fc5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:57.645132 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-0ae41012-b75f-4eda-9ba4-4362ceb37fc5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1519 microversion: 2.1 time: 0.166767 May 25 07:42:57.645739 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 398/761] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:57 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1519 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:57.753480 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-14acd395-ef2c-42d6-9787-32be5ce220be tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:57.754421 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-14acd395-ef2c-42d6-9787-32be5ce220be tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:57.760825 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-14acd395-ef2c-42d6-9787-32be5ce220be tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:57.761282 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-14acd395-ef2c-42d6-9787-32be5ce220be tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:57.762065 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-14acd395-ef2c-42d6-9787-32be5ce220be tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:57.762509 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-14acd395-ef2c-42d6-9787-32be5ce220be tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:57.796989 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-14acd395-ef2c-42d6-9787-32be5ce220be tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.048678 May 25 07:42:57.797673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 364/762] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:42:57 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments => generated 371 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:42:57.839753 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-3e709331-cfb8-468e-a48a-e5b5c5e44f89 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:57.840712 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-3e709331-cfb8-468e-a48a-e5b5c5e44f89 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:57.846987 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3e709331-cfb8-468e-a48a-e5b5c5e44f89 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:57.847459 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3e709331-cfb8-468e-a48a-e5b5c5e44f89 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:57.848210 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3e709331-cfb8-468e-a48a-e5b5c5e44f89 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:57.848693 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3e709331-cfb8-468e-a48a-e5b5c5e44f89 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:57.879407 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-3e709331-cfb8-468e-a48a-e5b5c5e44f89 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043804 May 25 07:42:57.879892 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 399/763] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:42:57 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:42:57.930076 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-43a997ef-ef1f-4e59-a4ba-4a285fa55c0b tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:57.930798 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-43a997ef-ef1f-4e59-a4ba-4a285fa55c0b tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: d2c1096c-18ac-4b61-bfc2-fb24367f2ce3] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:57.937313 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-43a997ef-ef1f-4e59-a4ba-4a285fa55c0b tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:57.937845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-43a997ef-ef1f-4e59-a4ba-4a285fa55c0b tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:57.938678 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-43a997ef-ef1f-4e59-a4ba-4a285fa55c0b tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:57.939120 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-43a997ef-ef1f-4e59-a4ba-4a285fa55c0b tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:57.948880 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-3962dc14-e663-4502-84fe-81c368279297 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:57.949462 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-3962dc14-e663-4502-84fe-81c368279297 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:57.953138 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-43a997ef-ef1f-4e59-a4ba-4a285fa55c0b tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] HTTP exception thrown: Instance d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 could not be found. May 25 07:42:57.957704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-43a997ef-ef1f-4e59-a4ba-4a285fa55c0b tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Request method failure captured: May 25 07:42:57.957704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 HTTP/1.1 May 25 07:42:57.957704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:42:57.957704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:42:57.957704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:42:57.957704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:42:57.957704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:42:57.957704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:42:57.957704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:42:57.957704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:42:57.957704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijd3tPF9Y0Bxo4QaV6dIMyf3ZWtmMbCxAOwO-7DnPqUcnfAWj2t0GGlXYPMApNRsshfH-ogd5uhzs5NcPKziC9N_75Bt__DCa14z6cuYy9qAWcfxDBTTWt57iQvKNYF-o8UJdpgRnV7SVvvdGNsHNsWv_ksVxq0MRlmz81tBoac2UyuA May 25 07:42:57.957704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:42:57.957704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:42:57.957704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:42:57.957704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:42:57.957704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:42:57.957704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:42:57.957704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: c16634316fc64493aef03cf073514273 May 25 07:42:57.957704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-VolumesActionsTest-1395778514 May 25 07:42:57.957704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:42:57.957704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:42:57.959345 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c16634316fc64493aef03cf073514273"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c16634316fc64493aef03cf073514273"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c16634316fc64493aef03cf073514273", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c16634316fc64493aef03cf073514273"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:42:57.959345 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-VolumesActionsTest-1395778514 May 25 07:42:57.959345 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: c16634316fc64493aef03cf073514273 May 25 07:42:57.959345 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-VolumesActionsTest-1395778514 May 25 07:42:57.959345 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-VolumesActionsTest-1395778514-project May 25 07:42:57.959345 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:42:57.959345 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:42:57.959345 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: c92e8b7fc090454c9498afef1d79e4bc May 25 07:42:57.959345 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-VolumesActionsTest-1395778514-project May 25 07:42:57.959345 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:42:57.959345 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Instance d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 could not be found. May 25 07:42:57.959345 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': 'd2c1096c-18ac-4b61-bfc2-fb24367f2ce3'} May 25 07:42:57.960226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:42:57.960226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:42:57.960226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:42:57.960226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:42:57.960226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:42:57.960226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:42:57.960226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:42:57.960226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:42:57.960226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:42:57.960226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:42:57.960226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 could not be found. May 25 07:42:57.960226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:42:57.960226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:42:57.960226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:42:57.960226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:42:57.960226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:42:57.960226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:42:57.960226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:42:57.960226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:42:57.960226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:42:57.961779 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:42:57.961779 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:42:57.961779 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:42:57.961779 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:42:57.961779 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:42:57.961779 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:42:57.961779 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:42:57.961779 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 could not be found. May 25 07:42:57.961779 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:42:57.961779 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:42:57.961779 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:42:57.961779 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:42:57.961779 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:42:57.961779 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:42:57.961779 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:42:57.961779 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:42:57.961779 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 could not be found. May 25 07:42:57.961779 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:42:57.963088 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-43a997ef-ef1f-4e59-a4ba-4a285fa55c0b tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Returning 404 to user: Instance d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:42:57.963179 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3962dc14-e663-4502-84fe-81c368279297 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:57.963275 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-43a997ef-ef1f-4e59-a4ba-4a285fa55c0b tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3" status: 404 len: 111 microversion: 2.1 time: 0.030032 May 25 07:42:57.963365 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3962dc14-e663-4502-84fe-81c368279297 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:57.963470 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 365/764] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:57 2022] GET /compute/v2.1/servers/d2c1096c-18ac-4b61-bfc2-fb24367f2ce3 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:42:57.963555 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3962dc14-e663-4502-84fe-81c368279297 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:57.963555 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3962dc14-e663-4502-84fe-81c368279297 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:57.988844 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-3962dc14-e663-4502-84fe-81c368279297 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments/69f6a2c9-ad9e-4255-bca9-5e0d8e29867f" status: 200 len: 194 microversion: 2.1 time: 0.044091 May 25 07:42:57.989443 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 400/765] 10.222.0.24 () {58 vars in 1412 bytes} [Wed May 25 07:42:57 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments/69f6a2c9-ad9e-4255-bca9-5e0d8e29867f => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:42:57.999172 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-fdcc9b67-b825-4283-a8b7-7dee0aeb1b56 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:57.999663 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-fdcc9b67-b825-4283-a8b7-7dee0aeb1b56 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:58.005888 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fdcc9b67-b825-4283-a8b7-7dee0aeb1b56 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:58.006341 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fdcc9b67-b825-4283-a8b7-7dee0aeb1b56 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:58.007304 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fdcc9b67-b825-4283-a8b7-7dee0aeb1b56 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:58.007847 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fdcc9b67-b825-4283-a8b7-7dee0aeb1b56 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:58.010435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b5b9ce16-74b9-4448-8701-08512cd32c74 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1900860248", "imageRef": "ddc5b622-a846-425a-b8fd-7e5caef00bf8", "flavorRef": "452", "networks": [{"uuid": "4da000a2-13db-425e-9154-d0d501197ba8"}]}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:42:58.063417 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.network.neutron [None req-b5b9ce16-74b9-4448-8701-08512cd32c74 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] validate_networks() for [('4da000a2-13db-425e-9154-d0d501197ba8', None, None, None, None, None)] {{(pid=124675) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:42:58.090252 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.objects.instance [None req-fdcc9b67-b825-4283-a8b7-7dee0aeb1b56 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lazy-loading 'services' on Instance uuid 2c5136fd-d373-4990-9a64-52d7549c48fa {{(pid=124674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:42:58.339258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-fdcc9b67-b825-4283-a8b7-7dee0aeb1b56 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "DELETE /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments/69f6a2c9-ad9e-4255-bca9-5e0d8e29867f" status: 202 len: 0 microversion: 2.1 time: 0.343880 May 25 07:42:58.340042 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 366/766] 10.222.0.24 () {58 vars in 1415 bytes} [Wed May 25 07:42:57 2022] DELETE /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments/69f6a2c9-ad9e-4255-bca9-5e0d8e29867f => generated 0 bytes in 345 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:42:58.418826 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-b5b9ce16-74b9-4448-8701-08512cd32c74 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Flavor limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:42:58.419262 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-b5b9ce16-74b9-4448-8701-08512cd32c74 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Image limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:42:58.419799 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-b5b9ce16-74b9-4448-8701-08512cd32c74 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Flavor pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:42:58.420234 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-b5b9ce16-74b9-4448-8701-08512cd32c74 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Image pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:42:58.420679 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-b5b9ce16-74b9-4448-8701-08512cd32c74 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:42:58.429520 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b5b9ce16-74b9-4448-8701-08512cd32c74 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:58.429975 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b5b9ce16-74b9-4448-8701-08512cd32c74 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:58.430782 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b5b9ce16-74b9-4448-8701-08512cd32c74 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:58.431225 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b5b9ce16-74b9-4448-8701-08512cd32c74 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:58.449906 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-b5b9ce16-74b9-4448-8701-08512cd32c74 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Getting quotas for project c16634316fc64493aef03cf073514273. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:42:58.454808 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-b5b9ce16-74b9-4448-8701-08512cd32c74 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Getting quotas for user c92e8b7fc090454c9498afef1d79e4bc and project c16634316fc64493aef03cf073514273. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:42:58.465909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b5b9ce16-74b9-4448-8701-08512cd32c74 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Going to run 1 instances... {{(pid=124675) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:42:58.469029 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b5b9ce16-74b9-4448-8701-08512cd32c74 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddc5b622-a846-425a-b8fd-7e5caef00bf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:42:58.604768 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b5b9ce16-74b9-4448-8701-08512cd32c74 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.598061 May 25 07:42:58.605495 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 401/767] 10.222.0.24 () {60 vars in 1146 bytes} [Wed May 25 07:42:58 2022] POST /compute/v2.1/servers => generated 380 bytes in 599 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) May 25 07:42:58.616155 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-3cc26ac9-1901-4d94-b471-e2a2e3368fb6 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:58.616887 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-3cc26ac9-1901-4d94-b471-e2a2e3368fb6 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:58.662433 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-f80668d4-f204-400b-a8ec-cbd86f4fa537 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:58.663175 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-f80668d4-f204-400b-a8ec-cbd86f4fa537 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:58.671284 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f80668d4-f204-400b-a8ec-cbd86f4fa537 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:58.671835 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f80668d4-f204-400b-a8ec-cbd86f4fa537 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:58.672859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f80668d4-f204-400b-a8ec-cbd86f4fa537 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:58.673396 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f80668d4-f204-400b-a8ec-cbd86f4fa537 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:58.678803 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-3cc26ac9-1901-4d94-b471-e2a2e3368fb6 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:58.694983 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-3cc26ac9-1901-4d94-b471-e2a2e3368fb6 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 200 len: 1214 microversion: 2.1 time: 0.080371 May 25 07:42:58.695991 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 367/768] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:58 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 1214 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:58.816961 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-f80668d4-f204-400b-a8ec-cbd86f4fa537 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:58.824516 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-f80668d4-f204-400b-a8ec-cbd86f4fa537 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1519 microversion: 2.1 time: 0.165954 May 25 07:42:58.825087 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 402/769] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:58 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1519 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:58.891535 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c47aa02c-2cd4-44d9-b6fd-efd7eaee0318 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:58.892583 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c47aa02c-2cd4-44d9-b6fd-efd7eaee0318 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:58.899866 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c47aa02c-2cd4-44d9-b6fd-efd7eaee0318 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:58.900313 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c47aa02c-2cd4-44d9-b6fd-efd7eaee0318 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:58.901114 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c47aa02c-2cd4-44d9-b6fd-efd7eaee0318 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:58.901565 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c47aa02c-2cd4-44d9-b6fd-efd7eaee0318 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:58.930159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c47aa02c-2cd4-44d9-b6fd-efd7eaee0318 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043320 May 25 07:42:58.930709 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 368/770] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:42:58 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:42:59.719709 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4f1a4e75-9b9f-43a4-8f98-b622e034b327 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:59.720332 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4f1a4e75-9b9f-43a4-8f98-b622e034b327 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:59.773278 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4f1a4e75-9b9f-43a4-8f98-b622e034b327 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:59.780715 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4f1a4e75-9b9f-43a4-8f98-b622e034b327 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 200 len: 1214 microversion: 2.1 time: 0.065448 May 25 07:42:59.781293 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 403/771] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:59 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 1214 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:42:59.846954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-75adeb8d-d330-4860-bf65-bc345259e272 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:59.847570 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-75adeb8d-d330-4860-bf65-bc345259e272 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:59.853562 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-75adeb8d-d330-4860-bf65-bc345259e272 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:59.854015 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-75adeb8d-d330-4860-bf65-bc345259e272 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:59.856680 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-75adeb8d-d330-4860-bf65-bc345259e272 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:59.856680 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-75adeb8d-d330-4860-bf65-bc345259e272 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:59.940857 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-c5d78faf-8ee6-455e-af6d-7627c3276fd8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:42:59.941830 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-c5d78faf-8ee6-455e-af6d-7627c3276fd8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:42:59.954232 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c5d78faf-8ee6-455e-af6d-7627c3276fd8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:59.954937 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c5d78faf-8ee6-455e-af6d-7627c3276fd8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:59.956070 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c5d78faf-8ee6-455e-af6d-7627c3276fd8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:42:59.956731 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c5d78faf-8ee6-455e-af6d-7627c3276fd8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:42:59.987966 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-c5d78faf-8ee6-455e-af6d-7627c3276fd8 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051010 May 25 07:42:59.988946 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 404/772] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:42:59 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:42:59.989708 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-75adeb8d-d330-4860-bf65-bc345259e272 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:42:59.997400 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-75adeb8d-d330-4860-bf65-bc345259e272 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1575 microversion: 2.1 time: 0.154331 May 25 07:42:59.997968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 369/773] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:42:59 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:00.799755 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-3b45d84e-de56-418d-9c2c-c3b974e1abca tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:00.800316 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-3b45d84e-de56-418d-9c2c-c3b974e1abca tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:00.807064 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3b45d84e-de56-418d-9c2c-c3b974e1abca tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:00.807519 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3b45d84e-de56-418d-9c2c-c3b974e1abca tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:00.808343 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3b45d84e-de56-418d-9c2c-c3b974e1abca tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:00.808823 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3b45d84e-de56-418d-9c2c-c3b974e1abca tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:00.883323 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-3b45d84e-de56-418d-9c2c-c3b974e1abca tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:00.891126 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-3b45d84e-de56-418d-9c2c-c3b974e1abca tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 200 len: 1218 microversion: 2.1 time: 0.095726 May 25 07:43:00.891930 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 405/774] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:00 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:01.000580 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-491f8e68-4d6e-4da5-b51f-b3f7417c502e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:01.001516 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-491f8e68-4d6e-4da5-b51f-b3f7417c502e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:01.008104 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-491f8e68-4d6e-4da5-b51f-b3f7417c502e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:01.009510 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-491f8e68-4d6e-4da5-b51f-b3f7417c502e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:01.009510 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-491f8e68-4d6e-4da5-b51f-b3f7417c502e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:01.009871 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-491f8e68-4d6e-4da5-b51f-b3f7417c502e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:01.015208 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-bc8c728f-f52c-4c77-be31-b5502f6145e2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:01.015837 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-bc8c728f-f52c-4c77-be31-b5502f6145e2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:01.022803 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-bc8c728f-f52c-4c77-be31-b5502f6145e2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:01.023499 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-bc8c728f-f52c-4c77-be31-b5502f6145e2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:01.024535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-bc8c728f-f52c-4c77-be31-b5502f6145e2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:01.025136 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-bc8c728f-f52c-4c77-be31-b5502f6145e2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:01.044338 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-491f8e68-4d6e-4da5-b51f-b3f7417c502e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.048635 May 25 07:43:01.049563 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 370/775] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:43:00 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07/os-volume_attachments => generated 25 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 07:43:01.123690 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-5db88ee9-577a-42ec-b123-64c4c070d276 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:01.124252 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-5db88ee9-577a-42ec-b123-64c4c070d276 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:01.134504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5db88ee9-577a-42ec-b123-64c4c070d276 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:01.134956 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5db88ee9-577a-42ec-b123-64c4c070d276 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:01.135745 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5db88ee9-577a-42ec-b123-64c4c070d276 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:01.136189 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5db88ee9-577a-42ec-b123-64c4c070d276 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:01.175697 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-5db88ee9-577a-42ec-b123-64c4c070d276 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Going to try to terminate instance {{(pid=124674) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:43:01.187455 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-bc8c728f-f52c-4c77-be31-b5502f6145e2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:01.195729 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-bc8c728f-f52c-4c77-be31-b5502f6145e2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1575 microversion: 2.1 time: 0.184506 May 25 07:43:01.196741 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 406/776] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:01 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1575 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:01.421257 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:01.547189 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-5db88ee9-577a-42ec-b123-64c4c070d276 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "DELETE /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 204 len: 0 microversion: 2.1 time: 0.427638 May 25 07:43:01.547794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 371/777] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:43:01 2022] DELETE /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 07:43:01.556195 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-56f56399-211a-41c3-ae91-8b420a0ac3d0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:01.556852 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-56f56399-211a-41c3-ae91-8b420a0ac3d0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:01.563078 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-56f56399-211a-41c3-ae91-8b420a0ac3d0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:01.563536 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-56f56399-211a-41c3-ae91-8b420a0ac3d0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:01.564340 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-56f56399-211a-41c3-ae91-8b420a0ac3d0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:01.564810 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-56f56399-211a-41c3-ae91-8b420a0ac3d0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:01.693493 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-56f56399-211a-41c3-ae91-8b420a0ac3d0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:01.701397 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-56f56399-211a-41c3-ae91-8b420a0ac3d0 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1682 microversion: 2.1 time: 0.149157 May 25 07:43:01.702245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 407/778] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:01 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1682 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:01.715612 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-8e9478b7-f4f2-44ce-97c5-333f78364e2c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:01.716205 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-8e9478b7-f4f2-44ce-97c5-333f78364e2c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:01.723233 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8e9478b7-f4f2-44ce-97c5-333f78364e2c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:01.723689 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8e9478b7-f4f2-44ce-97c5-333f78364e2c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:01.724462 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8e9478b7-f4f2-44ce-97c5-333f78364e2c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:01.724938 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8e9478b7-f4f2-44ce-97c5-333f78364e2c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:01.755471 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-8e9478b7-f4f2-44ce-97c5-333f78364e2c tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments/09cdd005-0243-42bc-bb9c-5adb2b354fb8" status: 200 len: 194 microversion: 2.1 time: 0.044342 May 25 07:43:01.756066 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 372/779] 10.222.0.24 () {58 vars in 1412 bytes} [Wed May 25 07:43:01 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments/09cdd005-0243-42bc-bb9c-5adb2b354fb8 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:43:01.766870 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-00eeb0f5-3e77-43cc-9851-cb6377128248 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:01.767376 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-00eeb0f5-3e77-43cc-9851-cb6377128248 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:01.773370 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-00eeb0f5-3e77-43cc-9851-cb6377128248 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:01.773827 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-00eeb0f5-3e77-43cc-9851-cb6377128248 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:01.774603 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-00eeb0f5-3e77-43cc-9851-cb6377128248 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:01.775043 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-00eeb0f5-3e77-43cc-9851-cb6377128248 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:01.855624 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.objects.instance [None req-00eeb0f5-3e77-43cc-9851-cb6377128248 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lazy-loading 'services' on Instance uuid 2c5136fd-d373-4990-9a64-52d7549c48fa {{(pid=124675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:43:01.859700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=100 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:01.908706 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-88c5cc43-c381-4967-926a-ba77216f60e4 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:01.909317 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-88c5cc43-c381-4967-926a-ba77216f60e4 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:01.915648 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-88c5cc43-c381-4967-926a-ba77216f60e4 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:01.916093 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-88c5cc43-c381-4967-926a-ba77216f60e4 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:01.916876 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-88c5cc43-c381-4967-926a-ba77216f60e4 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:01.917309 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-88c5cc43-c381-4967-926a-ba77216f60e4 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:01.979751 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-88c5cc43-c381-4967-926a-ba77216f60e4 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:01.987522 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-88c5cc43-c381-4967-926a-ba77216f60e4 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 200 len: 1266 microversion: 2.1 time: 0.083465 May 25 07:43:01.988084 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 373/780] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:01 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 1266 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:02.063167 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-00eeb0f5-3e77-43cc-9851-cb6377128248 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "DELETE /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments/09cdd005-0243-42bc-bb9c-5adb2b354fb8" status: 202 len: 0 microversion: 2.1 time: 0.301175 May 25 07:43:02.063765 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 408/781] 10.222.0.24 () {58 vars in 1415 bytes} [Wed May 25 07:43:01 2022] DELETE /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments/09cdd005-0243-42bc-bb9c-5adb2b354fb8 => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:43:02.214077 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-9f27d09e-a4d4-4faf-b8d0-3dab8783a37f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:02.214691 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-9f27d09e-a4d4-4faf-b8d0-3dab8783a37f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:02.223114 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9f27d09e-a4d4-4faf-b8d0-3dab8783a37f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:02.223599 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9f27d09e-a4d4-4faf-b8d0-3dab8783a37f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:02.224382 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9f27d09e-a4d4-4faf-b8d0-3dab8783a37f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:02.224837 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9f27d09e-a4d4-4faf-b8d0-3dab8783a37f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:02.362442 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9f27d09e-a4d4-4faf-b8d0-3dab8783a37f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:02.370476 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-9f27d09e-a4d4-4faf-b8d0-3dab8783a37f tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1575 microversion: 2.1 time: 0.160989 May 25 07:43:02.371038 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 374/782] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:02 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1575 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:02.719495 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8e95cc10-dbab-436c-8aa6-1726e5de199b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:02.720201 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-8e95cc10-dbab-436c-8aa6-1726e5de199b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:02.726549 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8e95cc10-dbab-436c-8aa6-1726e5de199b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:02.727010 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8e95cc10-dbab-436c-8aa6-1726e5de199b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:02.727774 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8e95cc10-dbab-436c-8aa6-1726e5de199b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:02.728219 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8e95cc10-dbab-436c-8aa6-1726e5de199b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:02.867962 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-8e95cc10-dbab-436c-8aa6-1726e5de199b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:02.876156 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-8e95cc10-dbab-436c-8aa6-1726e5de199b tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1682 microversion: 2.1 time: 0.161300 May 25 07:43:02.876751 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 409/783] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:02 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1682 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:03.005381 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-47f99505-6365-4594-be93-8c082e685e41 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:03.005914 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-47f99505-6365-4594-be93-8c082e685e41 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:03.011881 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-47f99505-6365-4594-be93-8c082e685e41 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:03.012324 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-47f99505-6365-4594-be93-8c082e685e41 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:03.013148 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-47f99505-6365-4594-be93-8c082e685e41 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:03.013586 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-47f99505-6365-4594-be93-8c082e685e41 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:03.078700 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-47f99505-6365-4594-be93-8c082e685e41 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:03.086259 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-47f99505-6365-4594-be93-8c082e685e41 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 200 len: 1266 microversion: 2.1 time: 0.084904 May 25 07:43:03.086822 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 375/784] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:03 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 1266 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:03.394460 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-89b36ad8-edca-44bd-a0ac-4bcd770aaaf6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:03.395107 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-89b36ad8-edca-44bd-a0ac-4bcd770aaaf6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:03.401302 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-89b36ad8-edca-44bd-a0ac-4bcd770aaaf6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:03.404638 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-89b36ad8-edca-44bd-a0ac-4bcd770aaaf6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:03.404638 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-89b36ad8-edca-44bd-a0ac-4bcd770aaaf6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:03.404638 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-89b36ad8-edca-44bd-a0ac-4bcd770aaaf6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:03.537005 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-89b36ad8-edca-44bd-a0ac-4bcd770aaaf6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:03.544729 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-89b36ad8-edca-44bd-a0ac-4bcd770aaaf6 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1575 microversion: 2.1 time: 0.154630 May 25 07:43:03.549555 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 410/785] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:03 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:43:03.895385 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-e18c0597-7ebc-4ad5-9d18-8705800cc835 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:03.895999 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-e18c0597-7ebc-4ad5-9d18-8705800cc835 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:03.902564 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e18c0597-7ebc-4ad5-9d18-8705800cc835 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:03.902963 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e18c0597-7ebc-4ad5-9d18-8705800cc835 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:03.903730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e18c0597-7ebc-4ad5-9d18-8705800cc835 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:03.904270 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e18c0597-7ebc-4ad5-9d18-8705800cc835 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:04.105933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-f53026e9-7890-4e8c-82c8-b4c8cd7db329 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:04.106786 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-f53026e9-7890-4e8c-82c8-b4c8cd7db329 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:04.114362 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f53026e9-7890-4e8c-82c8-b4c8cd7db329 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:04.115109 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f53026e9-7890-4e8c-82c8-b4c8cd7db329 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:04.116154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f53026e9-7890-4e8c-82c8-b4c8cd7db329 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:04.116631 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f53026e9-7890-4e8c-82c8-b4c8cd7db329 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:04.176015 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-e18c0597-7ebc-4ad5-9d18-8705800cc835 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:04.197911 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-e18c0597-7ebc-4ad5-9d18-8705800cc835 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1682 microversion: 2.1 time: 0.306529 May 25 07:43:04.208690 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 376/786] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:03 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1682 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:04.209659 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-f53026e9-7890-4e8c-82c8-b4c8cd7db329 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:04.221683 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-f53026e9-7890-4e8c-82c8-b4c8cd7db329 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 200 len: 1274 microversion: 2.1 time: 0.120138 May 25 07:43:04.222551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 411/787] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:04 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 1274 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:43:04.562535 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-45c34139-b439-461f-8a08-50d14df6c08b tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:04.563156 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-45c34139-b439-461f-8a08-50d14df6c08b tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:04.569827 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-45c34139-b439-461f-8a08-50d14df6c08b tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:04.570363 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-45c34139-b439-461f-8a08-50d14df6c08b tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:04.571144 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-45c34139-b439-461f-8a08-50d14df6c08b tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:04.571575 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-45c34139-b439-461f-8a08-50d14df6c08b tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:05.040834 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-45c34139-b439-461f-8a08-50d14df6c08b tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:05.049576 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-45c34139-b439-461f-8a08-50d14df6c08b tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1575 microversion: 2.1 time: 0.491594 May 25 07:43:05.050156 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 377/788] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:04 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1575 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:05.215362 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b665560c-61e1-4f9d-97b7-df5d791e1362 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:05.216009 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b665560c-61e1-4f9d-97b7-df5d791e1362 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:05.222380 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b665560c-61e1-4f9d-97b7-df5d791e1362 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:05.222839 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b665560c-61e1-4f9d-97b7-df5d791e1362 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:05.223608 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b665560c-61e1-4f9d-97b7-df5d791e1362 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:05.224043 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b665560c-61e1-4f9d-97b7-df5d791e1362 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:05.240264 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-29f708b2-9b7b-40e1-88d8-008282b08acc tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:05.241125 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-29f708b2-9b7b-40e1-88d8-008282b08acc tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:05.248735 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-29f708b2-9b7b-40e1-88d8-008282b08acc tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:05.249267 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-29f708b2-9b7b-40e1-88d8-008282b08acc tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:05.250314 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-29f708b2-9b7b-40e1-88d8-008282b08acc tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:05.250783 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-29f708b2-9b7b-40e1-88d8-008282b08acc tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:05.321586 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-29f708b2-9b7b-40e1-88d8-008282b08acc tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:05.330895 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-29f708b2-9b7b-40e1-88d8-008282b08acc tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 200 len: 1272 microversion: 2.1 time: 0.094490 May 25 07:43:05.331176 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 378/789] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:05 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 1272 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:43:05.378742 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b665560c-61e1-4f9d-97b7-df5d791e1362 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:05.382194 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b665560c-61e1-4f9d-97b7-df5d791e1362 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1682 microversion: 2.1 time: 0.170756 May 25 07:43:05.383182 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 412/790] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:05 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1682 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:43:05.384445 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-3e32fe9c-a692-46af-a526-3f4f60af432b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:05.392408 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-3e32fe9c-a692-46af-a526-3f4f60af432b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:05.392408 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3e32fe9c-a692-46af-a526-3f4f60af432b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:05.392408 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3e32fe9c-a692-46af-a526-3f4f60af432b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:05.393113 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3e32fe9c-a692-46af-a526-3f4f60af432b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:05.393551 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3e32fe9c-a692-46af-a526-3f4f60af432b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:05.419724 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:05.424246 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-3e32fe9c-a692-46af-a526-3f4f60af432b tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044424 May 25 07:43:05.424858 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 379/791] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:43:05 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 07:43:05.538058 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-d4a4a445-bd63-4814-bae6-56742e5bede4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:05.539065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-d4a4a445-bd63-4814-bae6-56742e5bede4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:05.546025 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d4a4a445-bd63-4814-bae6-56742e5bede4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:05.546503 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d4a4a445-bd63-4814-bae6-56742e5bede4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:05.547281 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d4a4a445-bd63-4814-bae6-56742e5bede4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:05.547722 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-d4a4a445-bd63-4814-bae6-56742e5bede4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:05.578253 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-d4a4a445-bd63-4814-bae6-56742e5bede4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044150 May 25 07:43:05.579873 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 413/792] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:43:05 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 07:43:05.641013 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-9114984f-bc9a-47d2-be31-a2cab2642a8f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:05.641604 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-9114984f-bc9a-47d2-be31-a2cab2642a8f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:05.648302 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9114984f-bc9a-47d2-be31-a2cab2642a8f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:05.650951 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9114984f-bc9a-47d2-be31-a2cab2642a8f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:05.650951 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9114984f-bc9a-47d2-be31-a2cab2642a8f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:05.650951 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9114984f-bc9a-47d2-be31-a2cab2642a8f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:05.676126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-9114984f-bc9a-47d2-be31-a2cab2642a8f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Going to try to terminate instance {{(pid=124674) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:43:05.805447 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-d9d81b10-0af1-40ed-b446-00abdad664a1 req-21eb4e0c-9476-4a6c-a902-4e9a8de155fc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e1792da3-df94-4a97-9f39-a2200abfad07", "name": "network-vif-deleted", "tag": "3879946e-3068-47dd-b88c-190f047d242d"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:43:05.819327 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-d9d81b10-0af1-40ed-b446-00abdad664a1 req-21eb4e0c-9476-4a6c-a902-4e9a8de155fc service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:05.820769 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-d9d81b10-0af1-40ed-b446-00abdad664a1 req-21eb4e0c-9476-4a6c-a902-4e9a8de155fc service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:05.842143 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-d9d81b10-0af1-40ed-b446-00abdad664a1 req-21eb4e0c-9476-4a6c-a902-4e9a8de155fc service nova] Creating event network-vif-deleted:3879946e-3068-47dd-b88c-190f047d242d for instance e1792da3-df94-4a97-9f39-a2200abfad07 on hv-cinder-82549 May 25 07:43:05.848963 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-d9d81b10-0af1-40ed-b446-00abdad664a1 req-21eb4e0c-9476-4a6c-a902-4e9a8de155fc service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049281 May 25 07:43:05.853007 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 414/793] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:43:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:43:06.067546 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-cae26301-5de7-49ac-8cd7-29f49d59349a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:06.068603 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-cae26301-5de7-49ac-8cd7-29f49d59349a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:06.075137 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cae26301-5de7-49ac-8cd7-29f49d59349a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:06.075588 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cae26301-5de7-49ac-8cd7-29f49d59349a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:06.077186 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cae26301-5de7-49ac-8cd7-29f49d59349a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:06.077609 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cae26301-5de7-49ac-8cd7-29f49d59349a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:06.224339 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-cae26301-5de7-49ac-8cd7-29f49d59349a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:06.232294 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-cae26301-5de7-49ac-8cd7-29f49d59349a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1575 microversion: 2.1 time: 0.168863 May 25 07:43:06.233515 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 415/794] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:06 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1575 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:43:06.329954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-9114984f-bc9a-47d2-be31-a2cab2642a8f tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "DELETE /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 204 len: 0 microversion: 2.1 time: 0.693084 May 25 07:43:06.346138 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 380/795] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:43:05 2022] DELETE /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 0 bytes in 695 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 07:43:06.346327 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8f347135-c3c9-454f-9379-1551f3bdac39 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:06.346327 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-8f347135-c3c9-454f-9379-1551f3bdac39 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:06.348102 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8f347135-c3c9-454f-9379-1551f3bdac39 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:06.348817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8f347135-c3c9-454f-9379-1551f3bdac39 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:06.349612 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8f347135-c3c9-454f-9379-1551f3bdac39 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:06.350056 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8f347135-c3c9-454f-9379-1551f3bdac39 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:06.368337 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c6d74ec2-352f-44a1-ae81-5274a419ebbe tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:06.370272 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c6d74ec2-352f-44a1-ae81-5274a419ebbe tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:06.379026 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c6d74ec2-352f-44a1-ae81-5274a419ebbe tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:06.380575 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c6d74ec2-352f-44a1-ae81-5274a419ebbe tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:06.380964 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c6d74ec2-352f-44a1-ae81-5274a419ebbe tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:06.381680 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c6d74ec2-352f-44a1-ae81-5274a419ebbe tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:06.502835 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-8f347135-c3c9-454f-9379-1551f3bdac39 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:06.512750 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-8f347135-c3c9-454f-9379-1551f3bdac39 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 200 len: 1673 microversion: 2.1 time: 0.177109 May 25 07:43:06.515388 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 416/796] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:06 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 1673 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:43:06.519502 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-84a25053-c7f0-4df3-a55e-4d14e31736a5 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:06.520471 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-84a25053-c7f0-4df3-a55e-4d14e31736a5 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:06.528605 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-84a25053-c7f0-4df3-a55e-4d14e31736a5 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:06.529894 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-84a25053-c7f0-4df3-a55e-4d14e31736a5 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:06.530852 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-84a25053-c7f0-4df3-a55e-4d14e31736a5 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:06.531300 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-84a25053-c7f0-4df3-a55e-4d14e31736a5 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:06.564463 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-84a25053-c7f0-4df3-a55e-4d14e31736a5 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:06.564944 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-84a25053-c7f0-4df3-a55e-4d14e31736a5 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:06.565614 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.objects.instance [None req-84a25053-c7f0-4df3-a55e-4d14e31736a5 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lazy-loading 'fault' on Instance uuid e1792da3-df94-4a97-9f39-a2200abfad07 {{(pid=124675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:43:06.601995 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c6d74ec2-352f-44a1-ae81-5274a419ebbe tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:06.611906 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c6d74ec2-352f-44a1-ae81-5274a419ebbe tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 200 len: 1314 microversion: 2.1 time: 0.257869 May 25 07:43:06.613078 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 381/797] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:06 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:06.621739 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-84a25053-c7f0-4df3-a55e-4d14e31736a5 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:06.630770 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-84a25053-c7f0-4df3-a55e-4d14e31736a5 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1331 microversion: 2.1 time: 0.114296 May 25 07:43:06.630770 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 417/798] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:06 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1331 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:07.251648 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-f45c1bec-be4b-4b76-b438-aa9788342645 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:07.252194 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-f45c1bec-be4b-4b76-b438-aa9788342645 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:07.258775 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f45c1bec-be4b-4b76-b438-aa9788342645 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:07.262928 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f45c1bec-be4b-4b76-b438-aa9788342645 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:07.262928 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f45c1bec-be4b-4b76-b438-aa9788342645 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:07.262928 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f45c1bec-be4b-4b76-b438-aa9788342645 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:07.389750 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-f45c1bec-be4b-4b76-b438-aa9788342645 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:07.397555 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-f45c1bec-be4b-4b76-b438-aa9788342645 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1575 microversion: 2.1 time: 0.150630 May 25 07:43:07.398337 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 382/799] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:07 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:43:07.531916 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-24d5241d-1411-465f-b468-f8475a2bca36 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:07.532450 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-24d5241d-1411-465f-b468-f8475a2bca36 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:07.539110 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-24d5241d-1411-465f-b468-f8475a2bca36 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:07.539570 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-24d5241d-1411-465f-b468-f8475a2bca36 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:07.540344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-24d5241d-1411-465f-b468-f8475a2bca36 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:07.540817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-24d5241d-1411-465f-b468-f8475a2bca36 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:07.629621 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-eea3f526-8017-4255-aedb-2d97db4e8dba tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:07.630333 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-eea3f526-8017-4255-aedb-2d97db4e8dba tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:07.636301 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-eea3f526-8017-4255-aedb-2d97db4e8dba tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:07.636797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-eea3f526-8017-4255-aedb-2d97db4e8dba tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:07.637577 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-eea3f526-8017-4255-aedb-2d97db4e8dba tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:07.638018 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-eea3f526-8017-4255-aedb-2d97db4e8dba tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:07.672159 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-24d5241d-1411-465f-b468-f8475a2bca36 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:07.679846 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-24d5241d-1411-465f-b468-f8475a2bca36 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 200 len: 1673 microversion: 2.1 time: 0.152496 May 25 07:43:07.680425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 418/800] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:07 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 1673 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:07.685073 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4bb09aaa-931f-434d-941c-d5cb0290dfae tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:07.685660 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4bb09aaa-931f-434d-941c-d5cb0290dfae tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:07.692166 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4bb09aaa-931f-434d-941c-d5cb0290dfae tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:07.692655 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4bb09aaa-931f-434d-941c-d5cb0290dfae tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:07.693446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4bb09aaa-931f-434d-941c-d5cb0290dfae tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:07.693893 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4bb09aaa-931f-434d-941c-d5cb0290dfae tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:07.725074 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4bb09aaa-931f-434d-941c-d5cb0290dfae tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:07.725528 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4bb09aaa-931f-434d-941c-d5cb0290dfae tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:07.725982 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.objects.instance [None req-4bb09aaa-931f-434d-941c-d5cb0290dfae tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lazy-loading 'fault' on Instance uuid e1792da3-df94-4a97-9f39-a2200abfad07 {{(pid=124675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:43:07.770080 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4bb09aaa-931f-434d-941c-d5cb0290dfae tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:07.770482 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-eea3f526-8017-4255-aedb-2d97db4e8dba tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:07.777736 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4bb09aaa-931f-434d-941c-d5cb0290dfae tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1331 microversion: 2.1 time: 0.096288 May 25 07:43:07.778017 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-eea3f526-8017-4255-aedb-2d97db4e8dba tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 200 len: 1314 microversion: 2.1 time: 0.152124 May 25 07:43:07.778319 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 419/801] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:07 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1331 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:07.779663 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 383/802] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:07 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:43:07.868896 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-54e0d98b-c33f-4145-8835-83964e7b68d4 req-0dad6517-e1ca-44ed-9f3d-f571ef677840 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c68d2ef2-2545-4cf8-9e80-bfd1669ddec8", "tag": "ed2acb4e-4c2d-4591-8817-6c12ed2cf554"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:43:07.877192 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-54e0d98b-c33f-4145-8835-83964e7b68d4 req-0dad6517-e1ca-44ed-9f3d-f571ef677840 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:07.877648 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-54e0d98b-c33f-4145-8835-83964e7b68d4 req-0dad6517-e1ca-44ed-9f3d-f571ef677840 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:07.888620 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-54e0d98b-c33f-4145-8835-83964e7b68d4 req-0dad6517-e1ca-44ed-9f3d-f571ef677840 service nova] Creating event network-changed:ed2acb4e-4c2d-4591-8817-6c12ed2cf554 for instance c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 on hv-cinder-82549 May 25 07:43:07.893470 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-54e0d98b-c33f-4145-8835-83964e7b68d4 req-0dad6517-e1ca-44ed-9f3d-f571ef677840 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028538 May 25 07:43:07.894060 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 420/803] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:43:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:43:08.414736 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-fec81794-3851-4b8a-a87f-4c97d9dc2bc5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:08.415255 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-fec81794-3851-4b8a-a87f-4c97d9dc2bc5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:08.421812 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fec81794-3851-4b8a-a87f-4c97d9dc2bc5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:08.422290 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fec81794-3851-4b8a-a87f-4c97d9dc2bc5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:08.423080 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fec81794-3851-4b8a-a87f-4c97d9dc2bc5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:08.423549 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fec81794-3851-4b8a-a87f-4c97d9dc2bc5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:08.641173 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-fec81794-3851-4b8a-a87f-4c97d9dc2bc5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:08.649595 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-fec81794-3851-4b8a-a87f-4c97d9dc2bc5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1575 microversion: 2.1 time: 0.238823 May 25 07:43:08.650174 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 384/804] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:08 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1575 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:08.694092 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=2 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:08.699053 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-958b6352-0813-4cf2-bdb7-8e4a822a2d9a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:08.699764 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-958b6352-0813-4cf2-bdb7-8e4a822a2d9a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:08.706234 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-958b6352-0813-4cf2-bdb7-8e4a822a2d9a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:08.706697 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-958b6352-0813-4cf2-bdb7-8e4a822a2d9a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:08.707475 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-958b6352-0813-4cf2-bdb7-8e4a822a2d9a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:08.707923 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-958b6352-0813-4cf2-bdb7-8e4a822a2d9a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:08.795896 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-516dd094-e5ca-4471-b641-7748c683e714 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:08.796537 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-516dd094-e5ca-4471-b641-7748c683e714 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:08.798531 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=2 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:08.803498 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-516dd094-e5ca-4471-b641-7748c683e714 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:08.803948 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-516dd094-e5ca-4471-b641-7748c683e714 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:08.804748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-516dd094-e5ca-4471-b641-7748c683e714 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:08.805185 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-516dd094-e5ca-4471-b641-7748c683e714 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:08.843894 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-958b6352-0813-4cf2-bdb7-8e4a822a2d9a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:08.852269 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-958b6352-0813-4cf2-bdb7-8e4a822a2d9a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 200 len: 1673 microversion: 2.1 time: 0.159027 May 25 07:43:08.852898 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 421/805] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:08 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:08.860994 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-092e41d0-2c6d-49f6-906c-16658d2c1269 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:08.860994 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-092e41d0-2c6d-49f6-906c-16658d2c1269 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:08.868341 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-092e41d0-2c6d-49f6-906c-16658d2c1269 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:08.868860 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-092e41d0-2c6d-49f6-906c-16658d2c1269 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:08.869891 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-092e41d0-2c6d-49f6-906c-16658d2c1269 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:08.870331 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-092e41d0-2c6d-49f6-906c-16658d2c1269 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:08.998667 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-516dd094-e5ca-4471-b641-7748c683e714 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:08.999120 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-516dd094-e5ca-4471-b641-7748c683e714 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:08.999578 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.objects.instance [None req-516dd094-e5ca-4471-b641-7748c683e714 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lazy-loading 'fault' on Instance uuid e1792da3-df94-4a97-9f39-a2200abfad07 {{(pid=124674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:43:09.009420 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-092e41d0-2c6d-49f6-906c-16658d2c1269 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:09.017589 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-092e41d0-2c6d-49f6-906c-16658d2c1269 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 200 len: 1314 microversion: 2.1 time: 0.163687 May 25 07:43:09.020520 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 422/806] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:08 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:09.042779 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-516dd094-e5ca-4471-b641-7748c683e714 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '0487ea9076ee4baf8138fdc25ce02522', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2d8e35800ce043acbcb027ce406ed2e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:09.049542 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-516dd094-e5ca-4471-b641-7748c683e714 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 200 len: 1331 microversion: 2.1 time: 0.258284 May 25 07:43:09.050102 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 385/807] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:08 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 1331 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:43:09.671607 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-e391d345-11ea-4e01-bdc4-db317ace9090 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:09.673994 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-e391d345-11ea-4e01-bdc4-db317ace9090 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:09.678370 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e391d345-11ea-4e01-bdc4-db317ace9090 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:09.678841 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e391d345-11ea-4e01-bdc4-db317ace9090 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:09.679610 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e391d345-11ea-4e01-bdc4-db317ace9090 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:09.680175 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e391d345-11ea-4e01-bdc4-db317ace9090 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:09.777119 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=8 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:09.823091 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-e391d345-11ea-4e01-bdc4-db317ace9090 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:09.827044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-e391d345-11ea-4e01-bdc4-db317ace9090 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1575 microversion: 2.1 time: 0.159806 May 25 07:43:09.827624 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 423/808] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:09 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1575 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:09.870722 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d9981e64-3ff8-4374-85dd-1bb89fc96ecc tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:09.871339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d9981e64-3ff8-4374-85dd-1bb89fc96ecc tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:09.878551 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d9981e64-3ff8-4374-85dd-1bb89fc96ecc tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:09.879013 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d9981e64-3ff8-4374-85dd-1bb89fc96ecc tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:09.879765 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d9981e64-3ff8-4374-85dd-1bb89fc96ecc tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:09.880264 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d9981e64-3ff8-4374-85dd-1bb89fc96ecc tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:10.038367 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ab44b89c-d8e7-4db5-b889-1649e22bc674 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:10.039752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ab44b89c-d8e7-4db5-b889-1649e22bc674 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:10.046544 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ab44b89c-d8e7-4db5-b889-1649e22bc674 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:10.046997 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ab44b89c-d8e7-4db5-b889-1649e22bc674 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:10.047774 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ab44b89c-d8e7-4db5-b889-1649e22bc674 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:10.048218 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ab44b89c-d8e7-4db5-b889-1649e22bc674 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:10.099940 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d9981e64-3ff8-4374-85dd-1bb89fc96ecc tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:10.108647 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d9981e64-3ff8-4374-85dd-1bb89fc96ecc tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 200 len: 1673 microversion: 2.1 time: 0.241729 May 25 07:43:10.118981 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 386/809] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:09 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 1673 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:10.118981 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-61281908-4420-478f-8733-d65fd0402e3c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:10.118981 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-61281908-4420-478f-8733-d65fd0402e3c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:10.121475 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-61281908-4420-478f-8733-d65fd0402e3c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:10.121935 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-61281908-4420-478f-8733-d65fd0402e3c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:10.122884 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-61281908-4420-478f-8733-d65fd0402e3c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:10.124142 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-61281908-4420-478f-8733-d65fd0402e3c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:10.137132 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-61281908-4420-478f-8733-d65fd0402e3c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] HTTP exception thrown: Instance e1792da3-df94-4a97-9f39-a2200abfad07 could not be found. May 25 07:43:10.138794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-61281908-4420-478f-8733-d65fd0402e3c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Request method failure captured: May 25 07:43:10.138794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 HTTP/1.1 May 25 07:43:10.138794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:43:10.138794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:43:10.138794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:43:10.138794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:43:10.138794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:43:10.138794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:43:10.138794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:43:10.138794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:43:10.138794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdyI17YkjQqKsTicl5BdlTZvAyQ_GMXlLJBh83Og-ZMS2KVi2Us0aJRqbM6uLQgUDMPeORhcs3ta8E3UdJWMvBXVjTqxdi2zYK0EmeD76I0JveUsx0Rz9WMLKSIeeZZQrA5vc_1CQNMm1pSzCady0n-o4b9yXkMaGi83bIjdMzlEcds May 25 07:43:10.138794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:43:10.138794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:43:10.138794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:43:10.138794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:43:10.138794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:43:10.138794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:43:10.138794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:43:10.138794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:10.138794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:43:10.138794 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:43:10.140439 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2d8e35800ce043acbcb027ce406ed2e7", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:43:10.140439 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:10.140439 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:43:10.140439 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:10.140439 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:43:10.140439 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:43:10.140439 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:43:10.140439 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: 0487ea9076ee4baf8138fdc25ce02522 May 25 07:43:10.140439 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:43:10.140439 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:43:10.140439 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Instance e1792da3-df94-4a97-9f39-a2200abfad07 could not be found. May 25 07:43:10.140439 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': 'e1792da3-df94-4a97-9f39-a2200abfad07'} May 25 07:43:10.141450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:43:10.141450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:10.141450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:43:10.141450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:43:10.141450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:43:10.141450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:43:10.141450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:43:10.141450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:43:10.141450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:43:10.141450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:43:10.141450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1792da3-df94-4a97-9f39-a2200abfad07 could not be found. May 25 07:43:10.141450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:10.141450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:10.141450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:10.141450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:10.141450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:10.141450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:10.141450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:43:10.141450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:43:10.141450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:43:10.143159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:43:10.143159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:43:10.143159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:43:10.143159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:43:10.143159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:43:10.143159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:43:10.143159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:43:10.143159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1792da3-df94-4a97-9f39-a2200abfad07 could not be found. May 25 07:43:10.143159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:10.143159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:10.143159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:10.143159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:10.143159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:10.143159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:10.143159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:43:10.143159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:43:10.143159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1792da3-df94-4a97-9f39-a2200abfad07 could not be found. May 25 07:43:10.143159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:10.145475 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-61281908-4420-478f-8733-d65fd0402e3c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Returning 404 to user: Instance e1792da3-df94-4a97-9f39-a2200abfad07 could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:43:10.145475 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-61281908-4420-478f-8733-d65fd0402e3c tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 404 len: 111 microversion: 2.1 time: 0.029729 May 25 07:43:10.145475 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 387/810] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:10 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:43:10.153345 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-0811d4d4-97f1-4df0-a2f8-5660e5aa3964 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '.version_select at 0x7fc864147670>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:10.196421 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ab44b89c-d8e7-4db5-b889-1649e22bc674 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:10.205060 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ab44b89c-d8e7-4db5-b889-1649e22bc674 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 200 len: 1314 microversion: 2.1 time: 0.171562 May 25 07:43:10.205642 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 424/811] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:10 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:10.238398 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-0811d4d4-97f1-4df0-a2f8-5660e5aa3964 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-717019098" status: 202 len: 0 microversion: 2.1 time: 0.089242 May 25 07:43:10.239236 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 388/812] 10.222.0.24 () {58 vars in 1217 bytes} [Wed May 25 07:43:10 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-717019098 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 07:43:10.337759 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-6210003f-6917-4f06-9fce-d6d5661aeb5a req-623439db-033c-4ce8-8002-8f8018b6eb79 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2c5136fd-d373-4990-9a64-52d7549c48fa", "name": "network-vif-deleted", "tag": "82e28fc3-f3d3-49bd-a344-d2f7bb0dbf27"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:43:10.341282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:10.347375 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-6210003f-6917-4f06-9fce-d6d5661aeb5a req-623439db-033c-4ce8-8002-8f8018b6eb79 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:10.347836 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-6210003f-6917-4f06-9fce-d6d5661aeb5a req-623439db-033c-4ce8-8002-8f8018b6eb79 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:10.359794 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-6210003f-6917-4f06-9fce-d6d5661aeb5a req-623439db-033c-4ce8-8002-8f8018b6eb79 service nova] Creating event network-vif-deleted:82e28fc3-f3d3-49bd-a344-d2f7bb0dbf27 for instance 2c5136fd-d373-4990-9a64-52d7549c48fa on hv-cinder-82549 May 25 07:43:10.365419 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-6210003f-6917-4f06-9fce-d6d5661aeb5a req-623439db-033c-4ce8-8002-8f8018b6eb79 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031409 May 25 07:43:10.366023 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 425/813] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:43:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:43:10.843551 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-dec96862-e87a-49cb-b936-27053551d97d tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:10.844839 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-dec96862-e87a-49cb-b936-27053551d97d tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:10.853305 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-dec96862-e87a-49cb-b936-27053551d97d tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:10.855925 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-dec96862-e87a-49cb-b936-27053551d97d tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:10.856623 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-dec96862-e87a-49cb-b936-27053551d97d tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:10.857321 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-dec96862-e87a-49cb-b936-27053551d97d tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:11.066940 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-dec96862-e87a-49cb-b936-27053551d97d tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:11.076204 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-dec96862-e87a-49cb-b936-27053551d97d tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1575 microversion: 2.1 time: 0.236748 May 25 07:43:11.077533 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 389/814] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:10 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1575 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:11.128691 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-e99aad63-fd27-4137-87f3-2692360a97c8 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:11.129409 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-e99aad63-fd27-4137-87f3-2692360a97c8 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:11.136346 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e99aad63-fd27-4137-87f3-2692360a97c8 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:11.136862 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e99aad63-fd27-4137-87f3-2692360a97c8 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:11.137698 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e99aad63-fd27-4137-87f3-2692360a97c8 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:11.138381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e99aad63-fd27-4137-87f3-2692360a97c8 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:11.153377 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:11.205622 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-e99aad63-fd27-4137-87f3-2692360a97c8 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '28d83ef95cda448dbd72acbd13a5f008', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '294afe2c36184564a80fb6bef7b32359', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:11.213566 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-e99aad63-fd27-4137-87f3-2692360a97c8 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 200 len: 1323 microversion: 2.1 time: 0.090756 May 25 07:43:11.214410 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 426/815] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:11 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 1323 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:11.233253 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-268cef2d-370a-4d05-89b0-9d8aea32a9bd tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:11.234549 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-268cef2d-370a-4d05-89b0-9d8aea32a9bd tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:11.245346 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-268cef2d-370a-4d05-89b0-9d8aea32a9bd tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:11.245893 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-268cef2d-370a-4d05-89b0-9d8aea32a9bd tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:11.246937 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-268cef2d-370a-4d05-89b0-9d8aea32a9bd tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:11.247455 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-268cef2d-370a-4d05-89b0-9d8aea32a9bd tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:11.681513 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-268cef2d-370a-4d05-89b0-9d8aea32a9bd tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:11.690164 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-268cef2d-370a-4d05-89b0-9d8aea32a9bd tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 200 len: 1314 microversion: 2.1 time: 0.461383 May 25 07:43:11.690712 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 390/816] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:11 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 1314 bytes in 463 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:12.094649 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-1e8645ea-1306-4af2-b6db-0d5f1c315ba5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:12.095271 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-1e8645ea-1306-4af2-b6db-0d5f1c315ba5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:12.102250 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1e8645ea-1306-4af2-b6db-0d5f1c315ba5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:12.102753 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1e8645ea-1306-4af2-b6db-0d5f1c315ba5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:12.103589 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1e8645ea-1306-4af2-b6db-0d5f1c315ba5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:12.104031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1e8645ea-1306-4af2-b6db-0d5f1c315ba5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:12.231483 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-3b6dd42a-144b-4cd7-9ecb-f0c235f0f1d4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:12.232799 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-3b6dd42a-144b-4cd7-9ecb-f0c235f0f1d4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:12.236605 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-1e8645ea-1306-4af2-b6db-0d5f1c315ba5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:12.239933 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3b6dd42a-144b-4cd7-9ecb-f0c235f0f1d4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:12.240386 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3b6dd42a-144b-4cd7-9ecb-f0c235f0f1d4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:12.241300 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3b6dd42a-144b-4cd7-9ecb-f0c235f0f1d4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:12.241808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3b6dd42a-144b-4cd7-9ecb-f0c235f0f1d4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:12.244734 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-1e8645ea-1306-4af2-b6db-0d5f1c315ba5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1575 microversion: 2.1 time: 0.155380 May 25 07:43:12.245304 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 427/817] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:12 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:12.255240 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-3b6dd42a-144b-4cd7-9ecb-f0c235f0f1d4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] HTTP exception thrown: Instance 2c5136fd-d373-4990-9a64-52d7549c48fa could not be found. May 25 07:43:12.256808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-3b6dd42a-144b-4cd7-9ecb-f0c235f0f1d4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Request method failure captured: May 25 07:43:12.256808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa HTTP/1.1 May 25 07:43:12.256808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:43:12.256808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:43:12.256808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:43:12.256808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:43:12.256808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:43:12.256808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:43:12.256808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:43:12.256808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:43:12.256808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdyNCjLy2qS9UhuPFuxBEq0FiclBvFD7JXrP14IWxENy6hbyxVEhXn--e--hqL5koIKvDVkaoHL9YjzaGGDLXh0Se_STUU_WMcqzc9izwYyxL1z8xYZKymgWf-6TyQiFw0RMMPsbea_1WKtaVVL73UJd08NiWUcJxWKAgjVdqvEgEvY May 25 07:43:12.256808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:43:12.256808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:43:12.256808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:43:12.256808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:43:12.256808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:43:12.256808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:43:12.256808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: 294afe2c36184564a80fb6bef7b32359 May 25 07:43:12.256808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-AttachVolumeTestJSON-631109292 May 25 07:43:12.256808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:43:12.256808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:43:12.258387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/294afe2c36184564a80fb6bef7b32359"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/294afe2c36184564a80fb6bef7b32359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_294afe2c36184564a80fb6bef7b32359", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/294afe2c36184564a80fb6bef7b32359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:43:12.258387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-AttachVolumeTestJSON-631109292 May 25 07:43:12.258387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: 294afe2c36184564a80fb6bef7b32359 May 25 07:43:12.258387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-AttachVolumeTestJSON-631109292 May 25 07:43:12.258387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-AttachVolumeTestJSON-631109292-project May 25 07:43:12.258387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:43:12.258387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:43:12.258387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: 28d83ef95cda448dbd72acbd13a5f008 May 25 07:43:12.258387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-AttachVolumeTestJSON-631109292-project May 25 07:43:12.258387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:43:12.258387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Instance 2c5136fd-d373-4990-9a64-52d7549c48fa could not be found. May 25 07:43:12.258387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': '2c5136fd-d373-4990-9a64-52d7549c48fa'} May 25 07:43:12.259285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:43:12.259285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:12.259285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:43:12.259285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:43:12.259285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:43:12.259285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:43:12.259285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:43:12.259285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:43:12.259285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:43:12.259285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:43:12.259285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c5136fd-d373-4990-9a64-52d7549c48fa could not be found. May 25 07:43:12.259285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:12.259285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:12.259285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:12.259285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:12.259285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:12.259285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:12.259285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:43:12.259285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:43:12.259285 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:43:12.260850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:43:12.260850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:43:12.260850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:43:12.260850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:43:12.260850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:43:12.260850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:43:12.260850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:43:12.260850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c5136fd-d373-4990-9a64-52d7549c48fa could not be found. May 25 07:43:12.260850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:12.260850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:12.260850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:12.260850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:12.260850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:12.260850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:12.260850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:43:12.260850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:43:12.260850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c5136fd-d373-4990-9a64-52d7549c48fa could not be found. May 25 07:43:12.260850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:12.262121 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-3b6dd42a-144b-4cd7-9ecb-f0c235f0f1d4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Returning 404 to user: Instance 2c5136fd-d373-4990-9a64-52d7549c48fa could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:43:12.262121 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-3b6dd42a-144b-4cd7-9ecb-f0c235f0f1d4 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 404 len: 111 microversion: 2.1 time: 0.031099 May 25 07:43:12.262121 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 391/818] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:12 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 07:43:12.267654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a8b06a52-e0fa-4292-af94-f0e631a2c8ac tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '.version_select at 0x7fc864320700>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:12.362300 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a8b06a52-e0fa-4292-af94-f0e631a2c8ac tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409151964" status: 202 len: 0 microversion: 2.1 time: 0.098836 May 25 07:43:12.362869 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 428/819] 10.222.0.24 () {58 vars in 1220 bytes} [Wed May 25 07:43:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1409151964 => generated 0 bytes in 100 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 07:43:12.445492 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-146481ce-9c3a-4065-9627-3fae3c28d33f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:12.445989 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-146481ce-9c3a-4065-9627-3fae3c28d33f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:12.452005 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-146481ce-9c3a-4065-9627-3fae3c28d33f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:12.453596 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-146481ce-9c3a-4065-9627-3fae3c28d33f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:12.453596 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-146481ce-9c3a-4065-9627-3fae3c28d33f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:12.453774 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-146481ce-9c3a-4065-9627-3fae3c28d33f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:12.466845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-146481ce-9c3a-4065-9627-3fae3c28d33f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] HTTP exception thrown: Instance e1792da3-df94-4a97-9f39-a2200abfad07 could not be found. May 25 07:43:12.468394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-146481ce-9c3a-4065-9627-3fae3c28d33f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Request method failure captured: May 25 07:43:12.468394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: DELETE /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 HTTP/1.1 May 25 07:43:12.468394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:43:12.468394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:43:12.468394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:43:12.468394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:43:12.468394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:43:12.468394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:43:12.468394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:43:12.468394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:43:12.468394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdyI17YkjQqKsTicl5BdlTZvAyQ_GMXlLJBh83Og-ZMS2KVi2Us0aJRqbM6uLQgUDMPeORhcs3ta8E3UdJWMvBXVjTqxdi2zYK0EmeD76I0JveUsx0Rz9WMLKSIeeZZQrA5vc_1CQNMm1pSzCady0n-o4b9yXkMaGi83bIjdMzlEcds May 25 07:43:12.468394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:43:12.468394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:43:12.468394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:43:12.468394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:43:12.468394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:43:12.468394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:43:12.468394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:43:12.468394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:12.468394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:43:12.468394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:43:12.469968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2d8e35800ce043acbcb027ce406ed2e7", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:43:12.469968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:12.469968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:43:12.469968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:12.469968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:43:12.469968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:43:12.469968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:43:12.469968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: 0487ea9076ee4baf8138fdc25ce02522 May 25 07:43:12.469968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:43:12.469968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:43:12.469968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Instance e1792da3-df94-4a97-9f39-a2200abfad07 could not be found. May 25 07:43:12.469968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': 'e1792da3-df94-4a97-9f39-a2200abfad07'} May 25 07:43:12.470882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:43:12.470882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:12.470882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:43:12.470882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:43:12.470882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:43:12.470882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:43:12.470882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:43:12.470882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:43:12.470882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:43:12.470882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:43:12.470882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1792da3-df94-4a97-9f39-a2200abfad07 could not be found. May 25 07:43:12.470882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:12.470882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:12.470882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:12.470882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:12.470882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:12.470882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:12.470882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:43:12.470882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:43:12.470882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:43:12.472044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:43:12.472044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 07:43:12.472044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 07:43:12.472044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 07:43:12.472044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 07:43:12.472044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:43:12.472044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:43:12.472044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:43:12.472044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:43:12.472044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1792da3-df94-4a97-9f39-a2200abfad07 could not be found. May 25 07:43:12.472044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:12.472044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:12.472044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:12.472044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:12.472044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:12.472044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:12.472044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:43:12.472044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:43:12.472044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1792da3-df94-4a97-9f39-a2200abfad07 could not be found. May 25 07:43:12.472044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:12.473244 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-146481ce-9c3a-4065-9627-3fae3c28d33f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Returning 404 to user: Instance e1792da3-df94-4a97-9f39-a2200abfad07 could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:43:12.473244 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-146481ce-9c3a-4065-9627-3fae3c28d33f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "DELETE /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 404 len: 111 microversion: 2.1 time: 0.028234 May 25 07:43:12.473244 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 392/820] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:43:12 2022] DELETE /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:43:12.478736 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8bbd8593-4678-4f96-b478-bdb962a9ae0e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:12.479399 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-8bbd8593-4678-4f96-b478-bdb962a9ae0e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: e1792da3-df94-4a97-9f39-a2200abfad07] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:12.486980 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8bbd8593-4678-4f96-b478-bdb962a9ae0e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:12.490994 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8bbd8593-4678-4f96-b478-bdb962a9ae0e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:12.490994 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8bbd8593-4678-4f96-b478-bdb962a9ae0e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:12.490994 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8bbd8593-4678-4f96-b478-bdb962a9ae0e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:12.504085 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-8bbd8593-4678-4f96-b478-bdb962a9ae0e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] HTTP exception thrown: Instance e1792da3-df94-4a97-9f39-a2200abfad07 could not be found. May 25 07:43:12.505909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8bbd8593-4678-4f96-b478-bdb962a9ae0e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Request method failure captured: May 25 07:43:12.505909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 HTTP/1.1 May 25 07:43:12.505909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:43:12.505909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:43:12.505909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:43:12.505909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:43:12.505909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:43:12.505909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:43:12.505909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:43:12.505909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:43:12.505909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijdyI17YkjQqKsTicl5BdlTZvAyQ_GMXlLJBh83Og-ZMS2KVi2Us0aJRqbM6uLQgUDMPeORhcs3ta8E3UdJWMvBXVjTqxdi2zYK0EmeD76I0JveUsx0Rz9WMLKSIeeZZQrA5vc_1CQNMm1pSzCady0n-o4b9yXkMaGi83bIjdMzlEcds May 25 07:43:12.505909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:43:12.505909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:43:12.505909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:43:12.505909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:43:12.505909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:43:12.505909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:43:12.505909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:43:12.505909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:12.505909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:43:12.505909 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:43:12.507458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2d8e35800ce043acbcb027ce406ed2e7", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:43:12.507458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:12.507458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:43:12.507458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:12.507458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:43:12.507458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:43:12.507458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:43:12.507458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: 0487ea9076ee4baf8138fdc25ce02522 May 25 07:43:12.507458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:43:12.507458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:43:12.507458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance e1792da3-df94-4a97-9f39-a2200abfad07 could not be found. May 25 07:43:12.507458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': 'e1792da3-df94-4a97-9f39-a2200abfad07'} May 25 07:43:12.508538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:43:12.508538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:12.508538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:43:12.508538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:43:12.508538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:43:12.508538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:43:12.508538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:43:12.508538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:43:12.508538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:43:12.508538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:43:12.508538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e1792da3-df94-4a97-9f39-a2200abfad07 could not be found. May 25 07:43:12.508538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:12.508538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:12.508538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:12.508538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:12.508538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:12.508538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:12.508538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:43:12.508538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:43:12.508538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:43:12.510065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:43:12.510065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:43:12.510065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:43:12.510065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:43:12.510065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:43:12.510065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:43:12.510065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:43:12.510065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e1792da3-df94-4a97-9f39-a2200abfad07 could not be found. May 25 07:43:12.510065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:12.510065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:12.510065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:12.510065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:12.510065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:12.510065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:12.510065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:43:12.510065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:43:12.510065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e1792da3-df94-4a97-9f39-a2200abfad07 could not be found. May 25 07:43:12.510065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:12.511366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8bbd8593-4678-4f96-b478-bdb962a9ae0e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Returning 404 to user: Instance e1792da3-df94-4a97-9f39-a2200abfad07 could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:43:12.511366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-8bbd8593-4678-4f96-b478-bdb962a9ae0e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07" status: 404 len: 111 microversion: 2.1 time: 0.032609 May 25 07:43:12.511366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 429/821] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:12 2022] GET /compute/v2.1/servers/e1792da3-df94-4a97-9f39-a2200abfad07 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 07:43:12.707284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-ee8f634b-08fd-4387-ac0e-6c4babadfbc9 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:12.708156 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-ee8f634b-08fd-4387-ac0e-6c4babadfbc9 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:12.714321 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ee8f634b-08fd-4387-ac0e-6c4babadfbc9 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:12.714781 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ee8f634b-08fd-4387-ac0e-6c4babadfbc9 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:12.715693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ee8f634b-08fd-4387-ac0e-6c4babadfbc9 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:12.716002 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ee8f634b-08fd-4387-ac0e-6c4babadfbc9 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:12.951880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-ee8f634b-08fd-4387-ac0e-6c4babadfbc9 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:12.960621 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-ee8f634b-08fd-4387-ac0e-6c4babadfbc9 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 200 len: 1314 microversion: 2.1 time: 0.257087 May 25 07:43:12.961727 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 393/822] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:12 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 1314 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:13.262761 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-0b238667-82df-4332-9b0e-d5991f57833a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:13.264765 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-0b238667-82df-4332-9b0e-d5991f57833a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:13.271836 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0b238667-82df-4332-9b0e-d5991f57833a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:13.272305 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0b238667-82df-4332-9b0e-d5991f57833a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:13.273161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0b238667-82df-4332-9b0e-d5991f57833a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:13.273584 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0b238667-82df-4332-9b0e-d5991f57833a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:13.310213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-8a3d3903-1170-4000-aeb6-3700ae3e967c req-d3846fe3-925d-43dd-a9db-c04813117900 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63430b83-f298-430c-9ca9-bdd4d69bde91", "name": "network-vif-plugged", "status": "completed", "tag": "6d5abc91-52ce-441e-be4e-749082dec7ae"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:43:13.321952 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-8a3d3903-1170-4000-aeb6-3700ae3e967c req-d3846fe3-925d-43dd-a9db-c04813117900 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:13.322999 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-8a3d3903-1170-4000-aeb6-3700ae3e967c req-d3846fe3-925d-43dd-a9db-c04813117900 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:13.336508 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-8a3d3903-1170-4000-aeb6-3700ae3e967c req-d3846fe3-925d-43dd-a9db-c04813117900 service nova] Creating event network-vif-plugged:6d5abc91-52ce-441e-be4e-749082dec7ae for instance 63430b83-f298-430c-9ca9-bdd4d69bde91 on hv-cinder-82549 May 25 07:43:13.342693 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-8a3d3903-1170-4000-aeb6-3700ae3e967c req-d3846fe3-925d-43dd-a9db-c04813117900 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035390 May 25 07:43:13.343556 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 394/823] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:43:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:43:13.426630 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-0b238667-82df-4332-9b0e-d5991f57833a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:13.434377 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-0b238667-82df-4332-9b0e-d5991f57833a tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1575 microversion: 2.1 time: 0.175744 May 25 07:43:13.435276 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 430/824] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:13 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1575 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:13.902075 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-bdfc1d70-0649-4a73-8faf-d53cffdf6f5e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:13.903367 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-bdfc1d70-0649-4a73-8faf-d53cffdf6f5e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:13.910908 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bdfc1d70-0649-4a73-8faf-d53cffdf6f5e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:13.911362 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bdfc1d70-0649-4a73-8faf-d53cffdf6f5e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:13.912131 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bdfc1d70-0649-4a73-8faf-d53cffdf6f5e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:13.912605 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-bdfc1d70-0649-4a73-8faf-d53cffdf6f5e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:13.926231 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-bdfc1d70-0649-4a73-8faf-d53cffdf6f5e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] HTTP exception thrown: Instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 could not be found. May 25 07:43:13.927892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-bdfc1d70-0649-4a73-8faf-d53cffdf6f5e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Request method failure captured: May 25 07:43:13.927892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: DELETE /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 HTTP/1.1 May 25 07:43:13.927892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:43:13.927892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:43:13.927892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:43:13.927892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:43:13.927892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:43:13.927892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:43:13.927892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:43:13.927892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:43:13.927892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdyI17YkjQqKsTicl5BdlTZvAyQ_GMXlLJBh83Og-ZMS2KVi2Us0aJRqbM6uLQgUDMPeORhcs3ta8E3UdJWMvBXVjTqxdi2zYK0EmeD76I0JveUsx0Rz9WMLKSIeeZZQrA5vc_1CQNMm1pSzCady0n-o4b9yXkMaGi83bIjdMzlEcds May 25 07:43:13.927892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:43:13.927892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:43:13.927892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:43:13.927892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:43:13.927892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:43:13.927892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:43:13.927892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:43:13.927892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:13.927892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:43:13.927892 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:43:13.929487 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2d8e35800ce043acbcb027ce406ed2e7", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:43:13.929487 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:13.929487 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:43:13.929487 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:13.929487 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:43:13.929487 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:43:13.929487 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:43:13.929487 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: 0487ea9076ee4baf8138fdc25ce02522 May 25 07:43:13.929487 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:43:13.929487 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:43:13.929487 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 could not be found. May 25 07:43:13.929487 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': '43b6c572-c0f9-46e4-bd01-0cc1583cfe58'} May 25 07:43:13.933256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:43:13.933256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:13.933256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:43:13.933256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:43:13.933256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:43:13.933256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:43:13.933256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:43:13.933256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:43:13.933256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:43:13.933256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:43:13.933256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 could not be found. May 25 07:43:13.933256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:13.933256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:13.933256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:13.933256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:13.933256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:13.933256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:13.933256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:43:13.933256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:43:13.933256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:43:13.934755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:43:13.934755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 07:43:13.934755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 07:43:13.934755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 07:43:13.934755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 07:43:13.934755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:43:13.934755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:43:13.934755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:43:13.934755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:43:13.934755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 could not be found. May 25 07:43:13.934755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:13.934755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:13.934755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:13.934755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:13.934755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:13.934755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:13.934755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:43:13.934755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:43:13.934755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 could not be found. May 25 07:43:13.934755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:13.937322 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-bdfc1d70-0649-4a73-8faf-d53cffdf6f5e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Returning 404 to user: Instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:43:13.937322 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-bdfc1d70-0649-4a73-8faf-d53cffdf6f5e tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "DELETE /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 404 len: 111 microversion: 2.1 time: 0.031911 May 25 07:43:13.937322 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 395/825] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:43:13 2022] DELETE /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:43:13.939177 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-96d1ff1d-1968-4403-b0b9-4d8a0c05282f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:13.939866 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-96d1ff1d-1968-4403-b0b9-4d8a0c05282f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 43b6c572-c0f9-46e4-bd01-0cc1583cfe58] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:13.946400 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-96d1ff1d-1968-4403-b0b9-4d8a0c05282f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:13.946858 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-96d1ff1d-1968-4403-b0b9-4d8a0c05282f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:13.947630 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-96d1ff1d-1968-4403-b0b9-4d8a0c05282f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:13.948074 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-96d1ff1d-1968-4403-b0b9-4d8a0c05282f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:13.962002 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-96d1ff1d-1968-4403-b0b9-4d8a0c05282f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] HTTP exception thrown: Instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 could not be found. May 25 07:43:13.963532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-96d1ff1d-1968-4403-b0b9-4d8a0c05282f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Request method failure captured: May 25 07:43:13.963532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 HTTP/1.1 May 25 07:43:13.963532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:43:13.963532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:43:13.963532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:43:13.963532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:43:13.963532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:43:13.963532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:43:13.963532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:43:13.963532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:43:13.963532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijdyI17YkjQqKsTicl5BdlTZvAyQ_GMXlLJBh83Og-ZMS2KVi2Us0aJRqbM6uLQgUDMPeORhcs3ta8E3UdJWMvBXVjTqxdi2zYK0EmeD76I0JveUsx0Rz9WMLKSIeeZZQrA5vc_1CQNMm1pSzCady0n-o4b9yXkMaGi83bIjdMzlEcds May 25 07:43:13.963532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:43:13.963532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:43:13.963532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:43:13.963532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:43:13.963532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:43:13.963532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:43:13.963532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:43:13.963532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:13.963532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:43:13.963532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:43:13.965152 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2d8e35800ce043acbcb027ce406ed2e7", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:43:13.965152 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:13.965152 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:43:13.965152 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:13.965152 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:43:13.965152 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:43:13.965152 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:43:13.965152 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: 0487ea9076ee4baf8138fdc25ce02522 May 25 07:43:13.965152 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:43:13.965152 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:43:13.965152 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 could not be found. May 25 07:43:13.965152 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': '43b6c572-c0f9-46e4-bd01-0cc1583cfe58'} May 25 07:43:13.969859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:43:13.969859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:13.969859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:43:13.969859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:43:13.969859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:43:13.969859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:43:13.969859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:43:13.969859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:43:13.969859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:43:13.969859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:43:13.969859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 could not be found. May 25 07:43:13.969859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:13.969859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:13.969859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:13.969859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:13.969859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:13.969859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:13.969859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:43:13.969859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:43:13.969859 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:43:13.971295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:43:13.971295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:43:13.971295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:43:13.971295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:43:13.971295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:43:13.971295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:43:13.971295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:43:13.971295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 could not be found. May 25 07:43:13.971295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:13.971295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:13.971295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:13.971295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:13.971295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:13.971295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:13.971295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:43:13.971295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:43:13.971295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 could not be found. May 25 07:43:13.971295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:13.972606 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-96d1ff1d-1968-4403-b0b9-4d8a0c05282f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Returning 404 to user: Instance 43b6c572-c0f9-46e4-bd01-0cc1583cfe58 could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:43:13.972606 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-96d1ff1d-1968-4403-b0b9-4d8a0c05282f tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58" status: 404 len: 111 microversion: 2.1 time: 0.030870 May 25 07:43:13.972606 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 431/826] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:13 2022] GET /compute/v2.1/servers/43b6c572-c0f9-46e4-bd01-0cc1583cfe58 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:43:13.974456 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-df81bfba-08b2-4985-bc55-6c56a9d45044 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:13.974967 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-df81bfba-08b2-4985-bc55-6c56a9d45044 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:13.978422 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-0ed98298-21df-44b2-b00d-401d44b55b1c tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:13.979035 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-0ed98298-21df-44b2-b00d-401d44b55b1c tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:13.981212 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-df81bfba-08b2-4985-bc55-6c56a9d45044 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:13.981673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-df81bfba-08b2-4985-bc55-6c56a9d45044 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:13.982548 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-df81bfba-08b2-4985-bc55-6c56a9d45044 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:13.982984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-df81bfba-08b2-4985-bc55-6c56a9d45044 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:13.985315 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0ed98298-21df-44b2-b00d-401d44b55b1c tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:13.985772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0ed98298-21df-44b2-b00d-401d44b55b1c tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:13.986557 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0ed98298-21df-44b2-b00d-401d44b55b1c tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:13.987000 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0ed98298-21df-44b2-b00d-401d44b55b1c tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:13.997135 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-df81bfba-08b2-4985-bc55-6c56a9d45044 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] HTTP exception thrown: Instance 93f35115-ef0f-4ed9-b573-04bd28bed194 could not be found. May 25 07:43:13.999166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-df81bfba-08b2-4985-bc55-6c56a9d45044 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Request method failure captured: May 25 07:43:13.999166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: DELETE /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 HTTP/1.1 May 25 07:43:13.999166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:43:13.999166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:43:13.999166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:43:13.999166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:43:13.999166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:43:13.999166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:43:13.999166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:43:13.999166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:43:13.999166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdyI17YkjQqKsTicl5BdlTZvAyQ_GMXlLJBh83Og-ZMS2KVi2Us0aJRqbM6uLQgUDMPeORhcs3ta8E3UdJWMvBXVjTqxdi2zYK0EmeD76I0JveUsx0Rz9WMLKSIeeZZQrA5vc_1CQNMm1pSzCady0n-o4b9yXkMaGi83bIjdMzlEcds May 25 07:43:13.999166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:43:13.999166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:43:13.999166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:43:13.999166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:43:13.999166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:43:13.999166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:43:13.999166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:43:13.999166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:13.999166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:43:13.999166 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:43:14.000829 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2d8e35800ce043acbcb027ce406ed2e7", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:43:14.000829 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:14.000829 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:43:14.000829 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:14.000829 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:43:14.000829 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:43:14.000829 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:43:14.000829 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: 0487ea9076ee4baf8138fdc25ce02522 May 25 07:43:14.000829 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:43:14.000829 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:43:14.000829 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Instance 93f35115-ef0f-4ed9-b573-04bd28bed194 could not be found. May 25 07:43:14.000829 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': '93f35115-ef0f-4ed9-b573-04bd28bed194'} May 25 07:43:14.001730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:43:14.001730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:14.001730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:43:14.001730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:43:14.001730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:43:14.001730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:43:14.001730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:43:14.001730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:43:14.001730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:43:14.001730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:43:14.001730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93f35115-ef0f-4ed9-b573-04bd28bed194 could not be found. May 25 07:43:14.001730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:14.001730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:14.001730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:14.001730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:14.001730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:14.001730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:14.001730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:43:14.001730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:43:14.001730 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:43:14.003147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:43:14.003147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 07:43:14.003147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 07:43:14.003147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 07:43:14.003147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 07:43:14.003147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:43:14.003147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:43:14.003147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:43:14.003147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:43:14.003147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93f35115-ef0f-4ed9-b573-04bd28bed194 could not be found. May 25 07:43:14.003147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:14.003147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:14.003147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:14.003147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:14.003147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:14.003147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:14.003147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:43:14.003147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:43:14.003147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93f35115-ef0f-4ed9-b573-04bd28bed194 could not be found. May 25 07:43:14.003147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:14.004830 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-df81bfba-08b2-4985-bc55-6c56a9d45044 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Returning 404 to user: Instance 93f35115-ef0f-4ed9-b573-04bd28bed194 could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:43:14.004830 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-df81bfba-08b2-4985-bc55-6c56a9d45044 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "DELETE /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 404 len: 111 microversion: 2.1 time: 0.030061 May 25 07:43:14.004830 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 396/827] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:43:13 2022] DELETE /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 07:43:14.008787 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-906cca26-6d40-4578-8ab4-77b4c2a8da21 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:14.009396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-906cca26-6d40-4578-8ab4-77b4c2a8da21 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: 93f35115-ef0f-4ed9-b573-04bd28bed194] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:14.016617 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-906cca26-6d40-4578-8ab4-77b4c2a8da21 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:14.017070 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-906cca26-6d40-4578-8ab4-77b4c2a8da21 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:14.017850 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-906cca26-6d40-4578-8ab4-77b4c2a8da21 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:14.018293 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-906cca26-6d40-4578-8ab4-77b4c2a8da21 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:14.033519 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-906cca26-6d40-4578-8ab4-77b4c2a8da21 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] HTTP exception thrown: Instance 93f35115-ef0f-4ed9-b573-04bd28bed194 could not be found. May 25 07:43:14.035942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-906cca26-6d40-4578-8ab4-77b4c2a8da21 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Request method failure captured: May 25 07:43:14.035942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 HTTP/1.1 May 25 07:43:14.035942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:43:14.035942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:43:14.035942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:43:14.035942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:43:14.035942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:43:14.035942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:43:14.035942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:43:14.035942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:43:14.035942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdyI17YkjQqKsTicl5BdlTZvAyQ_GMXlLJBh83Og-ZMS2KVi2Us0aJRqbM6uLQgUDMPeORhcs3ta8E3UdJWMvBXVjTqxdi2zYK0EmeD76I0JveUsx0Rz9WMLKSIeeZZQrA5vc_1CQNMm1pSzCady0n-o4b9yXkMaGi83bIjdMzlEcds May 25 07:43:14.035942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:43:14.035942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:43:14.035942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:43:14.035942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:43:14.035942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:43:14.035942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:43:14.035942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:43:14.035942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:14.035942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:43:14.035942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:43:14.037527 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2d8e35800ce043acbcb027ce406ed2e7", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:43:14.037527 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:14.037527 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:43:14.037527 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:14.037527 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:43:14.037527 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:43:14.037527 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:43:14.037527 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: 0487ea9076ee4baf8138fdc25ce02522 May 25 07:43:14.037527 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:43:14.037527 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:43:14.037527 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Instance 93f35115-ef0f-4ed9-b573-04bd28bed194 could not be found. May 25 07:43:14.037527 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': '93f35115-ef0f-4ed9-b573-04bd28bed194'} May 25 07:43:14.038387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:43:14.038387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:14.038387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:43:14.038387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:43:14.038387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:43:14.038387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:43:14.038387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:43:14.038387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:43:14.038387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:43:14.038387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:43:14.038387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 93f35115-ef0f-4ed9-b573-04bd28bed194 could not be found. May 25 07:43:14.038387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:14.038387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:14.038387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:14.038387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:14.038387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:14.038387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:14.038387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:43:14.038387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:43:14.038387 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:43:14.039804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:43:14.039804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:43:14.039804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:43:14.039804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:43:14.039804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:43:14.039804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:43:14.039804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:43:14.039804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 93f35115-ef0f-4ed9-b573-04bd28bed194 could not be found. May 25 07:43:14.039804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:14.039804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:14.039804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:14.039804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:14.039804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:14.039804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:14.039804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:43:14.039804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:43:14.039804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 93f35115-ef0f-4ed9-b573-04bd28bed194 could not be found. May 25 07:43:14.039804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:14.041184 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-906cca26-6d40-4578-8ab4-77b4c2a8da21 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Returning 404 to user: Instance 93f35115-ef0f-4ed9-b573-04bd28bed194 could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:43:14.041184 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-906cca26-6d40-4578-8ab4-77b4c2a8da21 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194" status: 404 len: 111 microversion: 2.1 time: 0.032223 May 25 07:43:14.042447 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 397/828] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:14 2022] GET /compute/v2.1/servers/93f35115-ef0f-4ed9-b573-04bd28bed194 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 07:43:14.123589 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-0ed98298-21df-44b2-b00d-401d44b55b1c tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:14.131110 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-0ed98298-21df-44b2-b00d-401d44b55b1c tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 200 len: 1314 microversion: 2.1 time: 0.157021 May 25 07:43:14.131694 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 432/829] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:13 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:43:14.453558 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-32a22ca7-416c-4e44-9bfa-118ea264cee1 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:14.454086 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-32a22ca7-416c-4e44-9bfa-118ea264cee1 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:14.460594 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-32a22ca7-416c-4e44-9bfa-118ea264cee1 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:14.461041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-32a22ca7-416c-4e44-9bfa-118ea264cee1 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:14.463853 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-32a22ca7-416c-4e44-9bfa-118ea264cee1 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:14.463853 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-32a22ca7-416c-4e44-9bfa-118ea264cee1 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:14.597382 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-32a22ca7-416c-4e44-9bfa-118ea264cee1 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:14.605151 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-32a22ca7-416c-4e44-9bfa-118ea264cee1 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1575 microversion: 2.1 time: 0.157142 May 25 07:43:14.605714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 398/830] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:14 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1575 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:14.987748 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ca43358e-4929-4446-9276-6b5fa75c70ce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:14.989035 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ca43358e-4929-4446-9276-6b5fa75c70ce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:14.995580 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ca43358e-4929-4446-9276-6b5fa75c70ce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:14.996062 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ca43358e-4929-4446-9276-6b5fa75c70ce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:14.996898 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ca43358e-4929-4446-9276-6b5fa75c70ce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:14.997374 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ca43358e-4929-4446-9276-6b5fa75c70ce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:15.027245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ca43358e-4929-4446-9276-6b5fa75c70ce tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043541 May 25 07:43:15.027802 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 433/831] 10.222.0.24 () {60 vars in 1342 bytes} [Wed May 25 07:43:14 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:15.090213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-6d8bd3bb-0d9e-40c0-9c8d-5bb0f54a2c1b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:15.090811 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-6d8bd3bb-0d9e-40c0-9c8d-5bb0f54a2c1b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:15.097914 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6d8bd3bb-0d9e-40c0-9c8d-5bb0f54a2c1b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:15.098447 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6d8bd3bb-0d9e-40c0-9c8d-5bb0f54a2c1b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:15.099260 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6d8bd3bb-0d9e-40c0-9c8d-5bb0f54a2c1b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:15.099741 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6d8bd3bb-0d9e-40c0-9c8d-5bb0f54a2c1b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:15.127396 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-6d8bd3bb-0d9e-40c0-9c8d-5bb0f54a2c1b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Going to try to terminate instance {{(pid=124674) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:43:15.142223 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:15.157633 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-73005dad-4c64-45cc-a111-5e11fb860cfb tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:15.157633 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-73005dad-4c64-45cc-a111-5e11fb860cfb tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:15.157633 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-73005dad-4c64-45cc-a111-5e11fb860cfb tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:15.157633 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-73005dad-4c64-45cc-a111-5e11fb860cfb tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:15.158268 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-73005dad-4c64-45cc-a111-5e11fb860cfb tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:15.158268 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-73005dad-4c64-45cc-a111-5e11fb860cfb tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:15.301687 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-73005dad-4c64-45cc-a111-5e11fb860cfb tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:15.310092 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-73005dad-4c64-45cc-a111-5e11fb860cfb tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 200 len: 1314 microversion: 2.1 time: 0.165851 May 25 07:43:15.310823 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 434/832] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:15 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:15.356585 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-5df75154-4f51-483b-8a74-7ea6901d4305 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:15.357998 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-5df75154-4f51-483b-8a74-7ea6901d4305 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:15.364934 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5df75154-4f51-483b-8a74-7ea6901d4305 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:15.365333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5df75154-4f51-483b-8a74-7ea6901d4305 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:15.366101 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5df75154-4f51-483b-8a74-7ea6901d4305 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:15.366544 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5df75154-4f51-483b-8a74-7ea6901d4305 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:15.380206 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-5df75154-4f51-483b-8a74-7ea6901d4305 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] HTTP exception thrown: Instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b could not be found. May 25 07:43:15.381901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-5df75154-4f51-483b-8a74-7ea6901d4305 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Request method failure captured: May 25 07:43:15.381901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: DELETE /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b HTTP/1.1 May 25 07:43:15.381901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:43:15.381901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:43:15.381901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:43:15.381901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:43:15.381901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:43:15.381901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:43:15.381901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:43:15.381901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:43:15.381901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijdyI17YkjQqKsTicl5BdlTZvAyQ_GMXlLJBh83Og-ZMS2KVi2Us0aJRqbM6uLQgUDMPeORhcs3ta8E3UdJWMvBXVjTqxdi2zYK0EmeD76I0JveUsx0Rz9WMLKSIeeZZQrA5vc_1CQNMm1pSzCady0n-o4b9yXkMaGi83bIjdMzlEcds May 25 07:43:15.381901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:43:15.381901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:43:15.381901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:43:15.381901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:43:15.381901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:43:15.381901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:43:15.381901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:43:15.381901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:15.381901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:43:15.381901 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:43:15.383547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2d8e35800ce043acbcb027ce406ed2e7", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:43:15.383547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:15.383547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:43:15.383547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:15.383547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:43:15.383547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:43:15.383547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:43:15.383547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: 0487ea9076ee4baf8138fdc25ce02522 May 25 07:43:15.383547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:43:15.383547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:43:15.383547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b could not be found. May 25 07:43:15.383547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': 'f7f15090-8fe0-4ebd-b4e6-2aad101f417b'} May 25 07:43:15.384381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:43:15.384381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:15.384381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:43:15.384381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:43:15.384381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:43:15.384381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:43:15.384381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:43:15.384381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:43:15.384381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:43:15.384381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:43:15.384381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b could not be found. May 25 07:43:15.384381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:15.384381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:15.384381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:15.384381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:15.384381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:15.384381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:15.384381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:43:15.384381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:43:15.384381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:43:15.386016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:43:15.386016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 07:43:15.386016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 07:43:15.386016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 07:43:15.386016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 07:43:15.386016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:43:15.386016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:43:15.386016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:43:15.386016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:43:15.386016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b could not be found. May 25 07:43:15.386016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:15.386016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:15.386016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:15.386016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:15.386016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:15.386016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:15.386016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:43:15.386016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:43:15.386016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b could not be found. May 25 07:43:15.386016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:15.387514 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-5df75154-4f51-483b-8a74-7ea6901d4305 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Returning 404 to user: Instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:43:15.387514 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-5df75154-4f51-483b-8a74-7ea6901d4305 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "DELETE /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 404 len: 111 microversion: 2.1 time: 0.031325 May 25 07:43:15.387514 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 435/833] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:43:15 2022] DELETE /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:43:15.390484 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-282eb9c4-c072-49f5-878e-16297b4fc1cb req-037400a6-cf3b-4b31-98ff-df291d914eda service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c68d2ef2-2545-4cf8-9e80-bfd1669ddec8", "name": "network-vif-plugged", "status": "completed", "tag": "ed2acb4e-4c2d-4591-8817-6c12ed2cf554"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:43:15.397714 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-282eb9c4-c072-49f5-878e-16297b4fc1cb req-037400a6-cf3b-4b31-98ff-df291d914eda service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:15.398166 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-282eb9c4-c072-49f5-878e-16297b4fc1cb req-037400a6-cf3b-4b31-98ff-df291d914eda service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:15.410666 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-282eb9c4-c072-49f5-878e-16297b4fc1cb req-037400a6-cf3b-4b31-98ff-df291d914eda service nova] Creating event network-vif-plugged:ed2acb4e-4c2d-4591-8817-6c12ed2cf554 for instance c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 on hv-cinder-82549 May 25 07:43:15.415451 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-282eb9c4-c072-49f5-878e-16297b4fc1cb req-037400a6-cf3b-4b31-98ff-df291d914eda service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029913 May 25 07:43:15.416038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 436/834] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:43:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:43:15.421904 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-c532acab-6c07-477f-8d50-f811f4167384 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:15.422601 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-c532acab-6c07-477f-8d50-f811f4167384 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] [instance: f7f15090-8fe0-4ebd-b4e6-2aad101f417b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:15.428773 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c532acab-6c07-477f-8d50-f811f4167384 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:15.429231 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c532acab-6c07-477f-8d50-f811f4167384 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:15.430003 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c532acab-6c07-477f-8d50-f811f4167384 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:15.430449 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c532acab-6c07-477f-8d50-f811f4167384 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:15.443842 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-c532acab-6c07-477f-8d50-f811f4167384 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] HTTP exception thrown: Instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b could not be found. May 25 07:43:15.448446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-c532acab-6c07-477f-8d50-f811f4167384 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Request method failure captured: May 25 07:43:15.448446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b HTTP/1.1 May 25 07:43:15.448446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:43:15.448446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:43:15.448446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:43:15.448446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:43:15.448446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:43:15.448446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:43:15.448446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:43:15.448446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:43:15.448446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijdyI17YkjQqKsTicl5BdlTZvAyQ_GMXlLJBh83Og-ZMS2KVi2Us0aJRqbM6uLQgUDMPeORhcs3ta8E3UdJWMvBXVjTqxdi2zYK0EmeD76I0JveUsx0Rz9WMLKSIeeZZQrA5vc_1CQNMm1pSzCady0n-o4b9yXkMaGi83bIjdMzlEcds May 25 07:43:15.448446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:43:15.448446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:43:15.448446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:43:15.448446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:43:15.448446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:43:15.448446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:43:15.448446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:43:15.448446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:15.448446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:43:15.448446 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:43:15.450103 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_2d8e35800ce043acbcb027ce406ed2e7", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/2d8e35800ce043acbcb027ce406ed2e7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:43:15.450103 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:15.450103 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: 2d8e35800ce043acbcb027ce406ed2e7 May 25 07:43:15.450103 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1464534600 May 25 07:43:15.450103 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:43:15.450103 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:43:15.450103 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:43:15.450103 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: 0487ea9076ee4baf8138fdc25ce02522 May 25 07:43:15.450103 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-AttachVolumeNegativeTest-1464534600-project May 25 07:43:15.450103 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:43:15.450103 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b could not be found. May 25 07:43:15.450103 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': 'f7f15090-8fe0-4ebd-b4e6-2aad101f417b'} May 25 07:43:15.451763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:43:15.451763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:15.451763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:43:15.451763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:43:15.451763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:43:15.451763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:43:15.451763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:43:15.451763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:43:15.451763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:43:15.451763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:43:15.451763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b could not be found. May 25 07:43:15.451763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:15.451763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:15.451763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:15.451763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:15.451763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:15.451763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:15.451763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:43:15.451763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:43:15.451763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:43:15.453247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:43:15.453247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:43:15.453247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:43:15.453247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:43:15.453247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:43:15.453247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:43:15.453247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:43:15.453247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b could not be found. May 25 07:43:15.453247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:15.453247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:15.453247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:15.453247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:15.453247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:15.453247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:15.453247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:43:15.453247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:43:15.453247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b could not be found. May 25 07:43:15.453247 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:15.455083 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-c532acab-6c07-477f-8d50-f811f4167384 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] Returning 404 to user: Instance f7f15090-8fe0-4ebd-b4e6-2aad101f417b could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:43:15.455083 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-c532acab-6c07-477f-8d50-f811f4167384 tempest-AttachVolumeNegativeTest-1464534600 tempest-AttachVolumeNegativeTest-1464534600-project] 10.222.0.24 "GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b" status: 404 len: 111 microversion: 2.1 time: 0.029840 May 25 07:43:15.455083 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 437/835] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:15 2022] GET /compute/v2.1/servers/f7f15090-8fe0-4ebd-b4e6-2aad101f417b => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:43:15.471389 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-6d8bd3bb-0d9e-40c0-9c8d-5bb0f54a2c1b tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 204 len: 0 microversion: 2.20 time: 0.384936 May 25 07:43:15.480067 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 399/836] 10.222.0.24 () {60 vars in 1279 bytes} [Wed May 25 07:43:15 2022] DELETE /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 0 bytes in 387 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 25 07:43:15.487130 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-50719515-a3dd-4d6a-9df4-1d5dda2e7c21 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:15.487750 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-50719515-a3dd-4d6a-9df4-1d5dda2e7c21 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:15.495123 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-50719515-a3dd-4d6a-9df4-1d5dda2e7c21 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:15.495738 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-50719515-a3dd-4d6a-9df4-1d5dda2e7c21 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:15.496435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-50719515-a3dd-4d6a-9df4-1d5dda2e7c21 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:15.497047 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-50719515-a3dd-4d6a-9df4-1d5dda2e7c21 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:15.627126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d6a53865-1e74-4f85-ad29-e41553f39bd5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:15.627874 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d6a53865-1e74-4f85-ad29-e41553f39bd5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:15.634350 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d6a53865-1e74-4f85-ad29-e41553f39bd5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:15.635143 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d6a53865-1e74-4f85-ad29-e41553f39bd5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:15.636084 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d6a53865-1e74-4f85-ad29-e41553f39bd5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:15.636509 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d6a53865-1e74-4f85-ad29-e41553f39bd5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:15.643697 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-50719515-a3dd-4d6a-9df4-1d5dda2e7c21 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:15.648490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-50719515-a3dd-4d6a-9df4-1d5dda2e7c21 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:15.650415 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-50719515-a3dd-4d6a-9df4-1d5dda2e7c21 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:15.651706 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-50719515-a3dd-4d6a-9df4-1d5dda2e7c21 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1724 microversion: 2.20 time: 0.168576 May 25 07:43:15.663023 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 438/837] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:43:15 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:43:15.854203 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d6a53865-1e74-4f85-ad29-e41553f39bd5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:15.862624 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d6a53865-1e74-4f85-ad29-e41553f39bd5 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1562 microversion: 2.1 time: 0.243242 May 25 07:43:15.863190 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 400/838] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:15 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1562 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:16.312889 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ac026925-e6ae-4cac-b086-6b2cd868ba9a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:16.313429 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ac026925-e6ae-4cac-b086-6b2cd868ba9a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:16.320067 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ac026925-e6ae-4cac-b086-6b2cd868ba9a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:16.320554 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ac026925-e6ae-4cac-b086-6b2cd868ba9a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:16.321338 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ac026925-e6ae-4cac-b086-6b2cd868ba9a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:16.321774 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ac026925-e6ae-4cac-b086-6b2cd868ba9a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:16.328115 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7c3d607b-6a19-4928-ad79-e3ce18d8728a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:16.328781 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-7c3d607b-6a19-4928-ad79-e3ce18d8728a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:16.335243 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7c3d607b-6a19-4928-ad79-e3ce18d8728a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:16.335564 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7c3d607b-6a19-4928-ad79-e3ce18d8728a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:16.336408 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7c3d607b-6a19-4928-ad79-e3ce18d8728a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:16.336877 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7c3d607b-6a19-4928-ad79-e3ce18d8728a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:16.337334 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-ac026925-e6ae-4cac-b086-6b2cd868ba9a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] HTTP exception thrown: Instance 2c5136fd-d373-4990-9a64-52d7549c48fa could not be found. May 25 07:43:16.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ac026925-e6ae-4cac-b086-6b2cd868ba9a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Request method failure captured: May 25 07:43:16.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: DELETE /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa HTTP/1.1 May 25 07:43:16.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:43:16.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:43:16.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:43:16.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:43:16.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:43:16.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:43:16.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:43:16.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:43:16.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijdyNCjLy2qS9UhuPFuxBEq0FiclBvFD7JXrP14IWxENy6hbyxVEhXn--e--hqL5koIKvDVkaoHL9YjzaGGDLXh0Se_STUU_WMcqzc9izwYyxL1z8xYZKymgWf-6TyQiFw0RMMPsbea_1WKtaVVL73UJd08NiWUcJxWKAgjVdqvEgEvY May 25 07:43:16.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:43:16.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:43:16.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:43:16.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:43:16.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:43:16.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:43:16.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: 294afe2c36184564a80fb6bef7b32359 May 25 07:43:16.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-AttachVolumeTestJSON-631109292 May 25 07:43:16.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:43:16.339317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:43:16.340926 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/294afe2c36184564a80fb6bef7b32359"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/294afe2c36184564a80fb6bef7b32359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_294afe2c36184564a80fb6bef7b32359", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/294afe2c36184564a80fb6bef7b32359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:43:16.340926 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-AttachVolumeTestJSON-631109292 May 25 07:43:16.340926 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: 294afe2c36184564a80fb6bef7b32359 May 25 07:43:16.340926 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-AttachVolumeTestJSON-631109292 May 25 07:43:16.340926 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-AttachVolumeTestJSON-631109292-project May 25 07:43:16.340926 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:43:16.340926 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:43:16.340926 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: 28d83ef95cda448dbd72acbd13a5f008 May 25 07:43:16.340926 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-AttachVolumeTestJSON-631109292-project May 25 07:43:16.340926 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:43:16.340926 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance 2c5136fd-d373-4990-9a64-52d7549c48fa could not be found. May 25 07:43:16.340926 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': '2c5136fd-d373-4990-9a64-52d7549c48fa'} May 25 07:43:16.349817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:43:16.349817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:16.349817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:43:16.349817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:43:16.349817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:43:16.349817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:43:16.349817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:43:16.349817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:43:16.349817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:43:16.349817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:43:16.349817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c5136fd-d373-4990-9a64-52d7549c48fa could not be found. May 25 07:43:16.349817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:16.349817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:16.349817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:16.349817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:16.349817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:16.349817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:16.349817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:43:16.349817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:43:16.349817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:43:16.351366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:43:16.351366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 07:43:16.351366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 07:43:16.351366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 07:43:16.351366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 07:43:16.351366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:43:16.351366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:43:16.351366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:43:16.351366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:43:16.351366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c5136fd-d373-4990-9a64-52d7549c48fa could not be found. May 25 07:43:16.351366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:16.351366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:16.351366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:16.351366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:16.351366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:16.351366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:16.351366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:43:16.351366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:43:16.351366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c5136fd-d373-4990-9a64-52d7549c48fa could not be found. May 25 07:43:16.351366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:16.352836 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ac026925-e6ae-4cac-b086-6b2cd868ba9a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Returning 404 to user: Instance 2c5136fd-d373-4990-9a64-52d7549c48fa could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:43:16.352836 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ac026925-e6ae-4cac-b086-6b2cd868ba9a tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "DELETE /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 404 len: 111 microversion: 2.1 time: 0.032053 May 25 07:43:16.352836 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 439/839] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:43:16 2022] DELETE /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:43:16.358491 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b8ce3683-25db-4e29-a4e8-6b8ef72f7c50 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:16.359159 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b8ce3683-25db-4e29-a4e8-6b8ef72f7c50 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: 2c5136fd-d373-4990-9a64-52d7549c48fa] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:16.365662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b8ce3683-25db-4e29-a4e8-6b8ef72f7c50 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:16.366129 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b8ce3683-25db-4e29-a4e8-6b8ef72f7c50 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:16.366915 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b8ce3683-25db-4e29-a4e8-6b8ef72f7c50 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:16.367366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b8ce3683-25db-4e29-a4e8-6b8ef72f7c50 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:16.383142 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-b8ce3683-25db-4e29-a4e8-6b8ef72f7c50 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] HTTP exception thrown: Instance 2c5136fd-d373-4990-9a64-52d7549c48fa could not be found. May 25 07:43:16.384732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b8ce3683-25db-4e29-a4e8-6b8ef72f7c50 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Request method failure captured: May 25 07:43:16.384732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa HTTP/1.1 May 25 07:43:16.384732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:43:16.384732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:43:16.384732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:43:16.384732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:43:16.384732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:43:16.384732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:43:16.384732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:43:16.384732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:43:16.384732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijdyNCjLy2qS9UhuPFuxBEq0FiclBvFD7JXrP14IWxENy6hbyxVEhXn--e--hqL5koIKvDVkaoHL9YjzaGGDLXh0Se_STUU_WMcqzc9izwYyxL1z8xYZKymgWf-6TyQiFw0RMMPsbea_1WKtaVVL73UJd08NiWUcJxWKAgjVdqvEgEvY May 25 07:43:16.384732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:43:16.384732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:43:16.384732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:43:16.384732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:43:16.384732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:43:16.384732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:43:16.384732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: 294afe2c36184564a80fb6bef7b32359 May 25 07:43:16.384732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-AttachVolumeTestJSON-631109292 May 25 07:43:16.384732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:43:16.384732 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:43:16.386134 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/294afe2c36184564a80fb6bef7b32359"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/294afe2c36184564a80fb6bef7b32359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_294afe2c36184564a80fb6bef7b32359", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/294afe2c36184564a80fb6bef7b32359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:43:16.386134 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-AttachVolumeTestJSON-631109292 May 25 07:43:16.386134 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: 294afe2c36184564a80fb6bef7b32359 May 25 07:43:16.386134 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-AttachVolumeTestJSON-631109292 May 25 07:43:16.386134 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-AttachVolumeTestJSON-631109292-project May 25 07:43:16.386134 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:43:16.386134 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:43:16.386134 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: 28d83ef95cda448dbd72acbd13a5f008 May 25 07:43:16.386134 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-AttachVolumeTestJSON-631109292-project May 25 07:43:16.386134 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:43:16.386134 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance 2c5136fd-d373-4990-9a64-52d7549c48fa could not be found. May 25 07:43:16.386134 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': '2c5136fd-d373-4990-9a64-52d7549c48fa'} May 25 07:43:16.389181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:43:16.389181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:16.389181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:43:16.389181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:43:16.389181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:43:16.389181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:43:16.389181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:43:16.389181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:43:16.389181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:43:16.389181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:43:16.389181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2c5136fd-d373-4990-9a64-52d7549c48fa could not be found. May 25 07:43:16.389181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:16.389181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:16.389181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:16.389181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:16.389181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:16.389181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:16.389181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:43:16.389181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:43:16.389181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:43:16.390733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:43:16.390733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:43:16.390733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:43:16.390733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:43:16.390733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:43:16.390733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:43:16.390733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:43:16.390733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2c5136fd-d373-4990-9a64-52d7549c48fa could not be found. May 25 07:43:16.390733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:16.390733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:16.390733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:16.390733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:16.390733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:16.390733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:16.390733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:43:16.390733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:43:16.390733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2c5136fd-d373-4990-9a64-52d7549c48fa could not be found. May 25 07:43:16.390733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:16.391854 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b8ce3683-25db-4e29-a4e8-6b8ef72f7c50 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Returning 404 to user: Instance 2c5136fd-d373-4990-9a64-52d7549c48fa could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:43:16.391854 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b8ce3683-25db-4e29-a4e8-6b8ef72f7c50 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa" status: 404 len: 111 microversion: 2.1 time: 0.031758 May 25 07:43:16.391854 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 440/840] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:16 2022] GET /compute/v2.1/servers/2c5136fd-d373-4990-9a64-52d7549c48fa => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) May 25 07:43:16.542132 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7c3d607b-6a19-4928-ad79-e3ce18d8728a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:16.550214 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-7c3d607b-6a19-4928-ad79-e3ce18d8728a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 200 len: 1314 microversion: 2.1 time: 0.226971 May 25 07:43:16.550783 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 401/841] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:16 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 1314 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:43:16.670693 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-62880d2f-824d-490f-ab20-f4feeea7a623 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:16.671479 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-62880d2f-824d-490f-ab20-f4feeea7a623 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:16.677560 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-62880d2f-824d-490f-ab20-f4feeea7a623 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:16.678015 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-62880d2f-824d-490f-ab20-f4feeea7a623 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:16.678789 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-62880d2f-824d-490f-ab20-f4feeea7a623 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:16.679231 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-62880d2f-824d-490f-ab20-f4feeea7a623 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:16.839498 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-62880d2f-824d-490f-ab20-f4feeea7a623 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:16.849177 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-62880d2f-824d-490f-ab20-f4feeea7a623 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:16.851197 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-62880d2f-824d-490f-ab20-f4feeea7a623 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:16.852725 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-62880d2f-824d-490f-ab20-f4feeea7a623 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1724 microversion: 2.20 time: 0.186145 May 25 07:43:16.853287 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 441/842] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:43:16 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1724 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:43:17.568385 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-0f7ea364-72e2-409c-a5e2-7406deee1f71 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:17.569939 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-0f7ea364-72e2-409c-a5e2-7406deee1f71 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:17.578712 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0f7ea364-72e2-409c-a5e2-7406deee1f71 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:17.586132 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0f7ea364-72e2-409c-a5e2-7406deee1f71 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:17.586132 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0f7ea364-72e2-409c-a5e2-7406deee1f71 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:17.586132 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0f7ea364-72e2-409c-a5e2-7406deee1f71 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:17.708552 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b8a0e503-d170-4316-8111-061429154c95 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:17.709728 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b8a0e503-d170-4316-8111-061429154c95 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:17.717868 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b8a0e503-d170-4316-8111-061429154c95 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:17.718728 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b8a0e503-d170-4316-8111-061429154c95 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:17.719685 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b8a0e503-d170-4316-8111-061429154c95 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:17.720280 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b8a0e503-d170-4316-8111-061429154c95 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:17.735700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-b8a0e503-d170-4316-8111-061429154c95 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] HTTP exception thrown: Instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 could not be found. May 25 07:43:17.737458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b8a0e503-d170-4316-8111-061429154c95 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Request method failure captured: May 25 07:43:17.737458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: DELETE /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 HTTP/1.1 May 25 07:43:17.737458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:43:17.737458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:43:17.737458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:43:17.737458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:43:17.737458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:43:17.737458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:43:17.737458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:43:17.737458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:43:17.737458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijdyNCjLy2qS9UhuPFuxBEq0FiclBvFD7JXrP14IWxENy6hbyxVEhXn--e--hqL5koIKvDVkaoHL9YjzaGGDLXh0Se_STUU_WMcqzc9izwYyxL1z8xYZKymgWf-6TyQiFw0RMMPsbea_1WKtaVVL73UJd08NiWUcJxWKAgjVdqvEgEvY May 25 07:43:17.737458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:43:17.737458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:43:17.737458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:43:17.737458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:43:17.737458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:43:17.737458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:43:17.737458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: 294afe2c36184564a80fb6bef7b32359 May 25 07:43:17.737458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-AttachVolumeTestJSON-631109292 May 25 07:43:17.737458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:43:17.737458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:43:17.739301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/294afe2c36184564a80fb6bef7b32359"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/294afe2c36184564a80fb6bef7b32359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_294afe2c36184564a80fb6bef7b32359", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/294afe2c36184564a80fb6bef7b32359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:43:17.739301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-AttachVolumeTestJSON-631109292 May 25 07:43:17.739301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: 294afe2c36184564a80fb6bef7b32359 May 25 07:43:17.739301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-AttachVolumeTestJSON-631109292 May 25 07:43:17.739301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-AttachVolumeTestJSON-631109292-project May 25 07:43:17.739301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:43:17.739301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:43:17.739301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: 28d83ef95cda448dbd72acbd13a5f008 May 25 07:43:17.739301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-AttachVolumeTestJSON-631109292-project May 25 07:43:17.739301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:43:17.739301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 could not be found. May 25 07:43:17.739301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': 'a8b10bee-95b1-4bfb-a9c5-6c15db78ba25'} May 25 07:43:17.740097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:43:17.740097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:17.740097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:43:17.740097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:43:17.740097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:43:17.740097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:43:17.740097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:43:17.740097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:43:17.740097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:43:17.740097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:43:17.740097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 could not be found. May 25 07:43:17.740097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:17.740097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:17.740097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:17.740097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:17.740097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:17.740097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:17.740097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:43:17.740097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:43:17.740097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:43:17.741646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:43:17.741646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 07:43:17.741646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 07:43:17.741646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 07:43:17.741646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 07:43:17.741646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:43:17.741646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:43:17.741646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:43:17.741646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:43:17.741646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 could not be found. May 25 07:43:17.741646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:17.741646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:17.741646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:17.741646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:17.741646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:17.741646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:17.741646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:43:17.741646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:43:17.741646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 could not be found. May 25 07:43:17.741646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:17.743952 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b8a0e503-d170-4316-8111-061429154c95 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Returning 404 to user: Instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:43:17.745007 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b8a0e503-d170-4316-8111-061429154c95 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "DELETE /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 404 len: 111 microversion: 2.1 time: 0.040879 May 25 07:43:17.746045 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 442/843] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:43:17 2022] DELETE /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:43:17.754539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-e73404fc-85fd-4fe2-bcf1-f894ed478586 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:17.755416 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-e73404fc-85fd-4fe2-bcf1-f894ed478586 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] [instance: a8b10bee-95b1-4bfb-a9c5-6c15db78ba25] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:17.763828 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e73404fc-85fd-4fe2-bcf1-f894ed478586 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:17.765914 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e73404fc-85fd-4fe2-bcf1-f894ed478586 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:17.766918 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e73404fc-85fd-4fe2-bcf1-f894ed478586 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:17.767633 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e73404fc-85fd-4fe2-bcf1-f894ed478586 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:17.788951 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-e73404fc-85fd-4fe2-bcf1-f894ed478586 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] HTTP exception thrown: Instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 could not be found. May 25 07:43:17.790551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-e73404fc-85fd-4fe2-bcf1-f894ed478586 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Request method failure captured: May 25 07:43:17.790551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 HTTP/1.1 May 25 07:43:17.790551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:43:17.790551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:43:17.790551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:43:17.790551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:43:17.790551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:43:17.790551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:43:17.790551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:43:17.790551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:43:17.790551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijdyNCjLy2qS9UhuPFuxBEq0FiclBvFD7JXrP14IWxENy6hbyxVEhXn--e--hqL5koIKvDVkaoHL9YjzaGGDLXh0Se_STUU_WMcqzc9izwYyxL1z8xYZKymgWf-6TyQiFw0RMMPsbea_1WKtaVVL73UJd08NiWUcJxWKAgjVdqvEgEvY May 25 07:43:17.790551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:43:17.790551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:43:17.790551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:43:17.790551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:43:17.790551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:43:17.790551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:43:17.790551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: 294afe2c36184564a80fb6bef7b32359 May 25 07:43:17.790551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-AttachVolumeTestJSON-631109292 May 25 07:43:17.790551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:43:17.790551 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:43:17.792066 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/294afe2c36184564a80fb6bef7b32359"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/294afe2c36184564a80fb6bef7b32359"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_294afe2c36184564a80fb6bef7b32359", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/294afe2c36184564a80fb6bef7b32359"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:43:17.792066 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-AttachVolumeTestJSON-631109292 May 25 07:43:17.792066 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: 294afe2c36184564a80fb6bef7b32359 May 25 07:43:17.792066 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-AttachVolumeTestJSON-631109292 May 25 07:43:17.792066 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-AttachVolumeTestJSON-631109292-project May 25 07:43:17.792066 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:43:17.792066 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:43:17.792066 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: 28d83ef95cda448dbd72acbd13a5f008 May 25 07:43:17.792066 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-AttachVolumeTestJSON-631109292-project May 25 07:43:17.792066 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:43:17.792066 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 could not be found. May 25 07:43:17.792066 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': 'a8b10bee-95b1-4bfb-a9c5-6c15db78ba25'} May 25 07:43:17.792933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:43:17.792933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:17.792933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:43:17.792933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:43:17.792933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:43:17.792933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:43:17.792933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:43:17.792933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:43:17.792933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:43:17.792933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:43:17.792933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 could not be found. May 25 07:43:17.792933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:17.792933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:17.792933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:17.792933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:17.792933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:17.792933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:17.792933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:43:17.792933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:43:17.792933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:43:17.794355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:43:17.794355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:43:17.794355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:43:17.794355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:43:17.794355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:43:17.794355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:43:17.794355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:43:17.794355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 could not be found. May 25 07:43:17.794355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:17.794355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:17.794355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:17.794355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:17.794355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:17.794355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:17.794355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:43:17.794355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:43:17.794355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 could not be found. May 25 07:43:17.794355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:17.796375 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-e73404fc-85fd-4fe2-bcf1-f894ed478586 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] Returning 404 to user: Instance a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:43:17.797425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-e73404fc-85fd-4fe2-bcf1-f894ed478586 tempest-AttachVolumeTestJSON-631109292 tempest-AttachVolumeTestJSON-631109292-project] 10.222.0.24 "GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25" status: 404 len: 111 microversion: 2.1 time: 0.047698 May 25 07:43:17.797984 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 443/844] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:17 2022] GET /compute/v2.1/servers/a8b10bee-95b1-4bfb-a9c5-6c15db78ba25 => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:43:17.871150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-7a837b35-0482-49bf-b68a-54ee839741c4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:17.871765 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-7a837b35-0482-49bf-b68a-54ee839741c4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:17.879345 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7a837b35-0482-49bf-b68a-54ee839741c4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:17.879345 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7a837b35-0482-49bf-b68a-54ee839741c4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:17.879345 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7a837b35-0482-49bf-b68a-54ee839741c4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:17.879809 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7a837b35-0482-49bf-b68a-54ee839741c4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:17.896766 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-0f7ea364-72e2-409c-a5e2-7406deee1f71 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:17.908349 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-0f7ea364-72e2-409c-a5e2-7406deee1f71 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 200 len: 1314 microversion: 2.1 time: 0.344866 May 25 07:43:17.908971 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 402/845] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:17 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 1314 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:18.393546 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-7a837b35-0482-49bf-b68a-54ee839741c4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:18.402588 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-7a837b35-0482-49bf-b68a-54ee839741c4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:18.406063 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-7a837b35-0482-49bf-b68a-54ee839741c4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:18.408021 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-7a837b35-0482-49bf-b68a-54ee839741c4 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1724 microversion: 2.20 time: 0.540202 May 25 07:43:18.409379 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 444/846] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:43:17 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1724 bytes in 543 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) May 25 07:43:18.927391 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-81f5d6f5-8866-4044-9472-568369ec1c5f tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:18.928006 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-81f5d6f5-8866-4044-9472-568369ec1c5f tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:18.934684 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-81f5d6f5-8866-4044-9472-568369ec1c5f tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:18.935189 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-81f5d6f5-8866-4044-9472-568369ec1c5f tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:18.936230 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-81f5d6f5-8866-4044-9472-568369ec1c5f tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:18.936734 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-81f5d6f5-8866-4044-9472-568369ec1c5f tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:19.367088 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-81f5d6f5-8866-4044-9472-568369ec1c5f tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:19.375729 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-81f5d6f5-8866-4044-9472-568369ec1c5f tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 200 len: 1498 microversion: 2.1 time: 0.452157 May 25 07:43:19.389771 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 403/847] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:18 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 1498 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:19.427963 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-2da9829e-0956-49b2-aa11-89bdf7d9ac6c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:19.428833 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-2da9829e-0956-49b2-aa11-89bdf7d9ac6c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:19.436950 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2da9829e-0956-49b2-aa11-89bdf7d9ac6c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:19.437796 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2da9829e-0956-49b2-aa11-89bdf7d9ac6c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:19.438694 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2da9829e-0956-49b2-aa11-89bdf7d9ac6c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:19.439262 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2da9829e-0956-49b2-aa11-89bdf7d9ac6c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:19.489755 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-3894e115-b5fe-46d0-9dc2-73164b178c4e req-cc018dc4-8037-439c-94b7-8bb73a181f12 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c0ecec15-f302-4eea-92e6-37049703fa41", "name": "network-vif-deleted", "tag": "28f4b108-96e9-447b-88dd-ed92dc19d98c"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:43:19.498758 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-3894e115-b5fe-46d0-9dc2-73164b178c4e req-cc018dc4-8037-439c-94b7-8bb73a181f12 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:19.499203 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-3894e115-b5fe-46d0-9dc2-73164b178c4e req-cc018dc4-8037-439c-94b7-8bb73a181f12 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:19.511114 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-3894e115-b5fe-46d0-9dc2-73164b178c4e req-cc018dc4-8037-439c-94b7-8bb73a181f12 service nova] Creating event network-vif-deleted:28f4b108-96e9-447b-88dd-ed92dc19d98c for instance c0ecec15-f302-4eea-92e6-37049703fa41 on hv-cinder-82549 May 25 07:43:19.517336 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-3894e115-b5fe-46d0-9dc2-73164b178c4e req-cc018dc4-8037-439c-94b7-8bb73a181f12 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031451 May 25 07:43:19.518255 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 404/848] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:43:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:43:19.557314 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-2da9829e-0956-49b2-aa11-89bdf7d9ac6c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:19.567183 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-2da9829e-0956-49b2-aa11-89bdf7d9ac6c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:19.574977 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-2da9829e-0956-49b2-aa11-89bdf7d9ac6c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '18eb8b615526451498d3adc382d5a410', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c4406d5d0e2347f1b96c34496f5ba5ae', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:19.576667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-2da9829e-0956-49b2-aa11-89bdf7d9ac6c tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 200 len: 1656 microversion: 2.20 time: 0.154048 May 25 07:43:19.577816 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 445/849] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:43:19 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 1656 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) May 25 07:43:20.598560 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-41261818-a8a8-497a-a65d-ac69cccfc747 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:20.599362 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-41261818-a8a8-497a-a65d-ac69cccfc747 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:20.611717 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-41261818-a8a8-497a-a65d-ac69cccfc747 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:20.612543 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-41261818-a8a8-497a-a65d-ac69cccfc747 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:20.615041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-41261818-a8a8-497a-a65d-ac69cccfc747 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:20.621600 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-41261818-a8a8-497a-a65d-ac69cccfc747 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:20.646022 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-41261818-a8a8-497a-a65d-ac69cccfc747 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] HTTP exception thrown: Instance c0ecec15-f302-4eea-92e6-37049703fa41 could not be found. May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-41261818-a8a8-497a-a65d-ac69cccfc747 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Request method failure captured: May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 HTTP/1.1 May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdyOBUPtSBv_eZ9cAz2wmqxZFgS0h6lu4oleBQhTwW57V0_ZEgIfF3Fa2nqQqpNtw6SNQ7TwNzOQPNz_TQi8qcT7_jV9J5Zk70rltDxuLkh_nBHTh2GRmxu7bokZP8XuH91WxV-Vdd3o5QvH60Jx6GJag75pCbi-MFMAELCN19x7CDo May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Openstack-Nova-Api-Version: 2.20 May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: c4406d5d0e2347f1b96c34496f5ba5ae May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-605607613 May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:43:20.647880 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:43:20.649302 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4406d5d0e2347f1b96c34496f5ba5ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c4406d5d0e2347f1b96c34496f5ba5ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c4406d5d0e2347f1b96c34496f5ba5ae", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4406d5d0e2347f1b96c34496f5ba5ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:43:20.649302 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-AttachVolumeShelveTestJSON-605607613 May 25 07:43:20.649302 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: c4406d5d0e2347f1b96c34496f5ba5ae May 25 07:43:20.649302 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-605607613 May 25 07:43:20.649302 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-AttachVolumeShelveTestJSON-605607613-project May 25 07:43:20.649302 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:43:20.649302 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:43:20.649302 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: 18eb8b615526451498d3adc382d5a410 May 25 07:43:20.649302 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-AttachVolumeShelveTestJSON-605607613-project May 25 07:43:20.649302 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:43:20.649302 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Instance c0ecec15-f302-4eea-92e6-37049703fa41 could not be found. May 25 07:43:20.649302 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': 'c0ecec15-f302-4eea-92e6-37049703fa41'} May 25 07:43:20.650117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:43:20.650117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:20.650117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:43:20.650117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:43:20.650117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:43:20.650117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:43:20.650117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:43:20.650117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:43:20.650117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:43:20.650117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:43:20.650117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0ecec15-f302-4eea-92e6-37049703fa41 could not be found. May 25 07:43:20.650117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:20.650117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:20.650117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:20.650117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:20.650117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:20.650117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:20.650117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:43:20.650117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:43:20.650117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:43:20.651504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:43:20.651504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:43:20.651504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:43:20.651504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:43:20.651504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:43:20.651504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:43:20.651504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:43:20.651504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0ecec15-f302-4eea-92e6-37049703fa41 could not be found. May 25 07:43:20.651504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:20.651504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:20.651504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:20.651504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:20.651504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:20.651504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:20.651504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:43:20.651504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:43:20.651504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0ecec15-f302-4eea-92e6-37049703fa41 could not be found. May 25 07:43:20.651504 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:20.652827 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-41261818-a8a8-497a-a65d-ac69cccfc747 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Returning 404 to user: Instance c0ecec15-f302-4eea-92e6-37049703fa41 could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:43:20.652827 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-41261818-a8a8-497a-a65d-ac69cccfc747 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 404 len: 111 microversion: 2.20 time: 0.057627 May 25 07:43:20.652827 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 405/850] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:43:20 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 111 bytes in 60 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 07:43:20.662181 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-895d8ea4-2a65-4d39-a8b2-f6233eddc241 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '.version_select at 0x7fc864168f70>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:20.663031 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-fb2d220e-81aa-486a-9a72-4cdbb16ac778 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:20.663531 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-fb2d220e-81aa-486a-9a72-4cdbb16ac778 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:20.672197 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fb2d220e-81aa-486a-9a72-4cdbb16ac778 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:20.679160 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fb2d220e-81aa-486a-9a72-4cdbb16ac778 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:20.679160 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fb2d220e-81aa-486a-9a72-4cdbb16ac778 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:20.679160 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fb2d220e-81aa-486a-9a72-4cdbb16ac778 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:20.742298 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-fb2d220e-81aa-486a-9a72-4cdbb16ac778 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Going to try to terminate instance {{(pid=124674) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:43:20.843050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-895d8ea4-2a65-4d39-a8b2-f6233eddc241 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542565806" status: 204 len: 0 microversion: 2.20 time: 0.184603 May 25 07:43:20.847481 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 446/851] 10.222.0.24 () {60 vars in 1261 bytes} [Wed May 25 07:43:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1542565806 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) May 25 07:43:21.265076 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-fb2d220e-81aa-486a-9a72-4cdbb16ac778 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 204 len: 0 microversion: 2.1 time: 0.605246 May 25 07:43:21.265712 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 406/852] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:43:20 2022] DELETE /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 0 bytes in 607 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) May 25 07:43:21.275373 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-079bce28-a13b-4afc-a301-d4dcb79027b8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:21.276282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-079bce28-a13b-4afc-a301-d4dcb79027b8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:21.283689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-079bce28-a13b-4afc-a301-d4dcb79027b8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:21.284447 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-079bce28-a13b-4afc-a301-d4dcb79027b8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:21.285449 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-079bce28-a13b-4afc-a301-d4dcb79027b8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:21.289351 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-079bce28-a13b-4afc-a301-d4dcb79027b8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:21.548198 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-079bce28-a13b-4afc-a301-d4dcb79027b8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:21.557999 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-079bce28-a13b-4afc-a301-d4dcb79027b8 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 200 len: 1504 microversion: 2.1 time: 0.287658 May 25 07:43:21.558579 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 447/853] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:21 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 1504 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:22.576812 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1cd1cca7-9366-4e7e-abc8-0bdd0565f93a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:22.577616 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-1cd1cca7-9366-4e7e-abc8-0bdd0565f93a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:22.588053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1cd1cca7-9366-4e7e-abc8-0bdd0565f93a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:22.588592 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1cd1cca7-9366-4e7e-abc8-0bdd0565f93a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:22.593962 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1cd1cca7-9366-4e7e-abc8-0bdd0565f93a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:22.593962 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1cd1cca7-9366-4e7e-abc8-0bdd0565f93a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:22.828187 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1cd1cca7-9366-4e7e-abc8-0bdd0565f93a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:22.836790 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-1cd1cca7-9366-4e7e-abc8-0bdd0565f93a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 200 len: 1504 microversion: 2.1 time: 0.264566 May 25 07:43:22.838102 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 407/854] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:22 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 1504 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:23.207674 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a2a25354-7eb8-4e2b-8677-6c08065dd541 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:23.208450 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a2a25354-7eb8-4e2b-8677-6c08065dd541 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:23.215714 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a2a25354-7eb8-4e2b-8677-6c08065dd541 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:23.216216 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a2a25354-7eb8-4e2b-8677-6c08065dd541 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:23.217464 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a2a25354-7eb8-4e2b-8677-6c08065dd541 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:23.217916 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a2a25354-7eb8-4e2b-8677-6c08065dd541 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:23.232897 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-a2a25354-7eb8-4e2b-8677-6c08065dd541 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] HTTP exception thrown: Instance c0ecec15-f302-4eea-92e6-37049703fa41 could not be found. May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a2a25354-7eb8-4e2b-8677-6c08065dd541 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Request method failure captured: May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: DELETE /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 HTTP/1.1 May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijdyOBUPtSBv_eZ9cAz2wmqxZFgS0h6lu4oleBQhTwW57V0_ZEgIfF3Fa2nqQqpNtw6SNQ7TwNzOQPNz_TQi8qcT7_jV9J5Zk70rltDxuLkh_nBHTh2GRmxu7bokZP8XuH91WxV-Vdd3o5QvH60Jx6GJag75pCbi-MFMAELCN19x7CDo May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Openstack-Nova-Api-Version: 2.20 May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: c4406d5d0e2347f1b96c34496f5ba5ae May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-605607613 May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:43:23.234832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:43:23.236333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4406d5d0e2347f1b96c34496f5ba5ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c4406d5d0e2347f1b96c34496f5ba5ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c4406d5d0e2347f1b96c34496f5ba5ae", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4406d5d0e2347f1b96c34496f5ba5ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:43:23.236333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-AttachVolumeShelveTestJSON-605607613 May 25 07:43:23.236333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: c4406d5d0e2347f1b96c34496f5ba5ae May 25 07:43:23.236333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-605607613 May 25 07:43:23.236333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-AttachVolumeShelveTestJSON-605607613-project May 25 07:43:23.236333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:43:23.236333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:43:23.236333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: 18eb8b615526451498d3adc382d5a410 May 25 07:43:23.236333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-AttachVolumeShelveTestJSON-605607613-project May 25 07:43:23.236333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:43:23.236333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance c0ecec15-f302-4eea-92e6-37049703fa41 could not be found. May 25 07:43:23.236333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': 'c0ecec15-f302-4eea-92e6-37049703fa41'} May 25 07:43:23.237150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:43:23.237150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:23.237150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:43:23.237150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:43:23.237150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:43:23.237150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:43:23.237150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:43:23.237150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:43:23.237150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:43:23.237150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:43:23.237150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0ecec15-f302-4eea-92e6-37049703fa41 could not be found. May 25 07:43:23.237150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:23.237150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:23.237150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:23.237150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:23.237150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:23.237150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:23.237150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:43:23.237150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:43:23.237150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:43:23.238425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:43:23.238425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 07:43:23.238425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 07:43:23.238425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 07:43:23.238425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 07:43:23.238425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:43:23.238425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:43:23.238425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:43:23.238425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:43:23.238425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0ecec15-f302-4eea-92e6-37049703fa41 could not be found. May 25 07:43:23.238425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:23.238425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:23.238425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:23.238425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:23.238425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:23.238425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:23.238425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:43:23.238425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:43:23.238425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0ecec15-f302-4eea-92e6-37049703fa41 could not be found. May 25 07:43:23.238425 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:23.246888 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a2a25354-7eb8-4e2b-8677-6c08065dd541 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Returning 404 to user: Instance c0ecec15-f302-4eea-92e6-37049703fa41 could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:43:23.246888 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a2a25354-7eb8-4e2b-8677-6c08065dd541 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "DELETE /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 404 len: 111 microversion: 2.20 time: 0.032882 May 25 07:43:23.246888 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 448/855] 10.222.0.24 () {60 vars in 1279 bytes} [Wed May 25 07:43:23 2022] DELETE /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 07:43:23.247248 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-5d862827-3908-42de-a442-a0fa48288889 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:23.247248 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-5d862827-3908-42de-a442-a0fa48288889 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: c0ecec15-f302-4eea-92e6-37049703fa41] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:23.249732 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=4,nova_api:DELETE=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:43:23.254560 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5d862827-3908-42de-a442-a0fa48288889 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:23.255126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5d862827-3908-42de-a442-a0fa48288889 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:23.255974 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5d862827-3908-42de-a442-a0fa48288889 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:23.256598 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5d862827-3908-42de-a442-a0fa48288889 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-5d862827-3908-42de-a442-a0fa48288889 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] HTTP exception thrown: Instance c0ecec15-f302-4eea-92e6-37049703fa41 could not be found. May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-5d862827-3908-42de-a442-a0fa48288889 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Request method failure captured: May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 HTTP/1.1 May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdyOBUPtSBv_eZ9cAz2wmqxZFgS0h6lu4oleBQhTwW57V0_ZEgIfF3Fa2nqQqpNtw6SNQ7TwNzOQPNz_TQi8qcT7_jV9J5Zk70rltDxuLkh_nBHTh2GRmxu7bokZP8XuH91WxV-Vdd3o5QvH60Jx6GJag75pCbi-MFMAELCN19x7CDo May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Openstack-Nova-Api-Version: 2.20 May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: c4406d5d0e2347f1b96c34496f5ba5ae May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-605607613 May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:43:23.276670 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:43:23.278253 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4406d5d0e2347f1b96c34496f5ba5ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c4406d5d0e2347f1b96c34496f5ba5ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c4406d5d0e2347f1b96c34496f5ba5ae", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4406d5d0e2347f1b96c34496f5ba5ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:43:23.278253 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-AttachVolumeShelveTestJSON-605607613 May 25 07:43:23.278253 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: c4406d5d0e2347f1b96c34496f5ba5ae May 25 07:43:23.278253 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-605607613 May 25 07:43:23.278253 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-AttachVolumeShelveTestJSON-605607613-project May 25 07:43:23.278253 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:43:23.278253 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:43:23.278253 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: 18eb8b615526451498d3adc382d5a410 May 25 07:43:23.278253 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-AttachVolumeShelveTestJSON-605607613-project May 25 07:43:23.278253 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:43:23.278253 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Instance c0ecec15-f302-4eea-92e6-37049703fa41 could not be found. May 25 07:43:23.278253 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': 'c0ecec15-f302-4eea-92e6-37049703fa41'} May 25 07:43:23.279954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:43:23.279954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:23.279954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:43:23.279954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:43:23.279954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:43:23.279954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:43:23.279954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:43:23.279954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:43:23.279954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:43:23.279954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:43:23.279954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c0ecec15-f302-4eea-92e6-37049703fa41 could not be found. May 25 07:43:23.279954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:23.279954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:23.279954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:23.279954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:23.279954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:23.279954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:23.279954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:43:23.279954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:43:23.279954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:43:23.281631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:43:23.281631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:43:23.281631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:43:23.281631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:43:23.281631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:43:23.281631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:43:23.281631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:43:23.281631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c0ecec15-f302-4eea-92e6-37049703fa41 could not be found. May 25 07:43:23.281631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:23.281631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:23.281631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:23.281631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:23.281631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:23.281631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:23.281631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:43:23.281631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:43:23.281631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c0ecec15-f302-4eea-92e6-37049703fa41 could not be found. May 25 07:43:23.281631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:23.282953 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-5d862827-3908-42de-a442-a0fa48288889 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Returning 404 to user: Instance c0ecec15-f302-4eea-92e6-37049703fa41 could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:43:23.282953 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-5d862827-3908-42de-a442-a0fa48288889 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41" status: 404 len: 111 microversion: 2.20 time: 0.032169 May 25 07:43:23.282953 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 408/856] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:43:23 2022] GET /compute/v2.1/servers/c0ecec15-f302-4eea-92e6-37049703fa41 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) May 25 07:43:23.378506 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-08741d1f-f158-43df-9ffe-b43b8e844496 req-e86e277c-ab32-4199-97d9-6f8cef1d6542 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c68d2ef2-2545-4cf8-9e80-bfd1669ddec8", "name": "network-vif-deleted", "tag": "ed2acb4e-4c2d-4591-8817-6c12ed2cf554"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:43:23.389256 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-08741d1f-f158-43df-9ffe-b43b8e844496 req-e86e277c-ab32-4199-97d9-6f8cef1d6542 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:23.389256 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-08741d1f-f158-43df-9ffe-b43b8e844496 req-e86e277c-ab32-4199-97d9-6f8cef1d6542 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:23.399752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-08741d1f-f158-43df-9ffe-b43b8e844496 req-e86e277c-ab32-4199-97d9-6f8cef1d6542 service nova] Creating event network-vif-deleted:ed2acb4e-4c2d-4591-8817-6c12ed2cf554 for instance c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 on hv-cinder-82549 May 25 07:43:23.405053 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-08741d1f-f158-43df-9ffe-b43b8e844496 req-e86e277c-ab32-4199-97d9-6f8cef1d6542 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030998 May 25 07:43:23.405726 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 449/857] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:43:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:43:23.853809 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-31fb2131-c6c4-4a0b-a07a-41c87833012a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:23.854423 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-31fb2131-c6c4-4a0b-a07a-41c87833012a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:23.861512 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-31fb2131-c6c4-4a0b-a07a-41c87833012a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:23.861910 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-31fb2131-c6c4-4a0b-a07a-41c87833012a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:23.862677 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-31fb2131-c6c4-4a0b-a07a-41c87833012a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:23.863124 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-31fb2131-c6c4-4a0b-a07a-41c87833012a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:23.934467 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-31fb2131-c6c4-4a0b-a07a-41c87833012a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c92e8b7fc090454c9498afef1d79e4bc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c16634316fc64493aef03cf073514273', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:43:23.942700 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-31fb2131-c6c4-4a0b-a07a-41c87833012a tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 200 len: 1299 microversion: 2.1 time: 0.092834 May 25 07:43:23.943472 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 409/858] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:23 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 1299 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:24.964071 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1cf70333-51bd-4656-b3f3-af373a9ea4b8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:24.967004 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-daab6705-9844-4c3a-b8b9-fc90a65b9882 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:24.967810 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-1cf70333-51bd-4656-b3f3-af373a9ea4b8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:24.971021 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-daab6705-9844-4c3a-b8b9-fc90a65b9882 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] [instance: c68d2ef2-2545-4cf8-9e80-bfd1669ddec8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:24.975968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1cf70333-51bd-4656-b3f3-af373a9ea4b8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:24.976422 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1cf70333-51bd-4656-b3f3-af373a9ea4b8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:24.977538 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1cf70333-51bd-4656-b3f3-af373a9ea4b8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:24.978143 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1cf70333-51bd-4656-b3f3-af373a9ea4b8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:24.978294 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-daab6705-9844-4c3a-b8b9-fc90a65b9882 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:24.978918 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-daab6705-9844-4c3a-b8b9-fc90a65b9882 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:24.979702 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-daab6705-9844-4c3a-b8b9-fc90a65b9882 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:24.980147 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-daab6705-9844-4c3a-b8b9-fc90a65b9882 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:24.992853 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-1cf70333-51bd-4656-b3f3-af373a9ea4b8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] HTTP exception thrown: Instance 6d360341-449d-4b49-8b66-a02a969171fd could not be found. May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1cf70333-51bd-4656-b3f3-af373a9ea4b8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Request method failure captured: May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: DELETE /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd HTTP/1.1 May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdyOBUPtSBv_eZ9cAz2wmqxZFgS0h6lu4oleBQhTwW57V0_ZEgIfF3Fa2nqQqpNtw6SNQ7TwNzOQPNz_TQi8qcT7_jV9J5Zk70rltDxuLkh_nBHTh2GRmxu7bokZP8XuH91WxV-Vdd3o5QvH60Jx6GJag75pCbi-MFMAELCN19x7CDo May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Openstack-Nova-Api-Version: 2.20 May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: c4406d5d0e2347f1b96c34496f5ba5ae May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-605607613 May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:43:24.994501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:43:24.996262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4406d5d0e2347f1b96c34496f5ba5ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c4406d5d0e2347f1b96c34496f5ba5ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c4406d5d0e2347f1b96c34496f5ba5ae", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4406d5d0e2347f1b96c34496f5ba5ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:43:24.996262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-AttachVolumeShelveTestJSON-605607613 May 25 07:43:24.996262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: c4406d5d0e2347f1b96c34496f5ba5ae May 25 07:43:24.996262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-605607613 May 25 07:43:24.996262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-AttachVolumeShelveTestJSON-605607613-project May 25 07:43:24.996262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:43:24.996262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:43:24.996262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: 18eb8b615526451498d3adc382d5a410 May 25 07:43:24.996262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-AttachVolumeShelveTestJSON-605607613-project May 25 07:43:24.996262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:43:24.996262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Instance 6d360341-449d-4b49-8b66-a02a969171fd could not be found. May 25 07:43:24.996262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': '6d360341-449d-4b49-8b66-a02a969171fd'} May 25 07:43:25.000696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:43:25.000696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:25.000696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:43:25.000696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:43:25.000696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:43:25.000696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:43:25.000696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:43:25.000696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:43:25.000696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:43:25.000696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:43:25.000696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d360341-449d-4b49-8b66-a02a969171fd could not be found. May 25 07:43:25.000696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:25.000696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:25.000696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:25.000696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:25.000696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:25.000696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:25.000696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:43:25.000696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:43:25.000696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:43:25.002289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:43:25.002289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 07:43:25.002289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 07:43:25.002289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 07:43:25.002289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 07:43:25.002289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:43:25.002289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:43:25.002289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:43:25.002289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:43:25.002289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d360341-449d-4b49-8b66-a02a969171fd could not be found. May 25 07:43:25.002289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:25.002289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:25.002289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:25.002289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:25.002289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:25.002289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:25.002289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:43:25.002289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:43:25.002289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d360341-449d-4b49-8b66-a02a969171fd could not be found. May 25 07:43:25.002289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:25.003810 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1cf70333-51bd-4656-b3f3-af373a9ea4b8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Returning 404 to user: Instance 6d360341-449d-4b49-8b66-a02a969171fd could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:43:25.003810 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-1cf70333-51bd-4656-b3f3-af373a9ea4b8 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "DELETE /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 404 len: 111 microversion: 2.20 time: 0.035893 May 25 07:43:25.003810 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 410/859] 10.222.0.24 () {60 vars in 1279 bytes} [Wed May 25 07:43:24 2022] DELETE /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-daab6705-9844-4c3a-b8b9-fc90a65b9882 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] HTTP exception thrown: Instance c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 could not be found. May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-daab6705-9844-4c3a-b8b9-fc90a65b9882 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Request method failure captured: May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 HTTP/1.1 May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijd3tPF9Y0Bxo4QaV6dIMyf3ZWtmMbCxAOwO-7DnPqUcnfAWj2t0GGlXYPMApNRsshfH-ogd5uhzs5NcPKziC9N_75Bt__DCa14z6cuYy9qAWcfxDBTTWt57iQvKNYF-o8UJdpgRnV7SVvvdGNsHNsWv_ksVxq0MRlmz81tBoac2UyuA May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: c16634316fc64493aef03cf073514273 May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-VolumesActionsTest-1395778514 May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:43:25.004057 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:43:25.008680 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c16634316fc64493aef03cf073514273"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c16634316fc64493aef03cf073514273"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c16634316fc64493aef03cf073514273", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c16634316fc64493aef03cf073514273"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:43:25.008680 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-VolumesActionsTest-1395778514 May 25 07:43:25.008680 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: c16634316fc64493aef03cf073514273 May 25 07:43:25.008680 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-VolumesActionsTest-1395778514 May 25 07:43:25.008680 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-VolumesActionsTest-1395778514-project May 25 07:43:25.008680 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:43:25.008680 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:43:25.008680 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: c92e8b7fc090454c9498afef1d79e4bc May 25 07:43:25.008680 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-VolumesActionsTest-1395778514-project May 25 07:43:25.008680 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:43:25.008680 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 could not be found. May 25 07:43:25.008680 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': 'c68d2ef2-2545-4cf8-9e80-bfd1669ddec8'} May 25 07:43:25.010435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:43:25.010435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:25.010435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:43:25.010435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:43:25.010435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:43:25.010435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:43:25.010435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:43:25.010435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:43:25.010435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:43:25.010435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:43:25.010435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 could not be found. May 25 07:43:25.010435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:25.010435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:25.010435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:25.010435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:25.010435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:25.010435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:25.010435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:43:25.010435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:43:25.010435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:43:25.013352 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:43:25.013352 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:43:25.013352 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:43:25.013352 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:43:25.013352 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:43:25.013352 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:43:25.013352 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:43:25.013352 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 could not be found. May 25 07:43:25.013352 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:25.013352 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:25.013352 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:25.013352 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:25.013352 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:25.013352 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:25.013352 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:43:25.013352 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:43:25.013352 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 could not be found. May 25 07:43:25.013352 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:25.014543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-daab6705-9844-4c3a-b8b9-fc90a65b9882 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] Returning 404 to user: Instance c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:43:25.014543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-daab6705-9844-4c3a-b8b9-fc90a65b9882 tempest-VolumesActionsTest-1395778514 tempest-VolumesActionsTest-1395778514-project] 10.222.0.24 "GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8" status: 404 len: 111 microversion: 2.1 time: 0.047226 May 25 07:43:25.014543 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 450/860] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:43:24 2022] GET /compute/v2.1/servers/c68d2ef2-2545-4cf8-9e80-bfd1669ddec8 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:43:25.014762 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-b461e678-c4f6-4f39-9984-5bcd0c90f337 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:25.014762 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-b461e678-c4f6-4f39-9984-5bcd0c90f337 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] [instance: 6d360341-449d-4b49-8b66-a02a969171fd] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:43:25.014762 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b461e678-c4f6-4f39-9984-5bcd0c90f337 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:25.014762 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b461e678-c4f6-4f39-9984-5bcd0c90f337 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:25.015045 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b461e678-c4f6-4f39-9984-5bcd0c90f337 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:43:25.015045 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-b461e678-c4f6-4f39-9984-5bcd0c90f337 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:43:25.029108 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-b461e678-c4f6-4f39-9984-5bcd0c90f337 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] HTTP exception thrown: Instance 6d360341-449d-4b49-8b66-a02a969171fd could not be found. May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-b461e678-c4f6-4f39-9984-5bcd0c90f337 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Request method failure captured: May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd HTTP/1.1 May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijdyOBUPtSBv_eZ9cAz2wmqxZFgS0h6lu4oleBQhTwW57V0_ZEgIfF3Fa2nqQqpNtw6SNQ7TwNzOQPNz_TQi8qcT7_jV9J5Zk70rltDxuLkh_nBHTh2GRmxu7bokZP8XuH91WxV-Vdd3o5QvH60Jx6GJag75pCbi-MFMAELCN19x7CDo May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Openstack-Nova-Api-Version: 2.20 May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: c4406d5d0e2347f1b96c34496f5ba5ae May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-605607613 May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:43:25.030685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:43:25.037736 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4406d5d0e2347f1b96c34496f5ba5ae"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/c4406d5d0e2347f1b96c34496f5ba5ae"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_c4406d5d0e2347f1b96c34496f5ba5ae", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/c4406d5d0e2347f1b96c34496f5ba5ae"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:43:25.037736 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-AttachVolumeShelveTestJSON-605607613 May 25 07:43:25.037736 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: c4406d5d0e2347f1b96c34496f5ba5ae May 25 07:43:25.037736 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-605607613 May 25 07:43:25.037736 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-AttachVolumeShelveTestJSON-605607613-project May 25 07:43:25.037736 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:43:25.037736 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:43:25.037736 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: 18eb8b615526451498d3adc382d5a410 May 25 07:43:25.037736 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-AttachVolumeShelveTestJSON-605607613-project May 25 07:43:25.037736 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:43:25.037736 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Instance 6d360341-449d-4b49-8b66-a02a969171fd could not be found. May 25 07:43:25.037736 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': '6d360341-449d-4b49-8b66-a02a969171fd'} May 25 07:43:25.039087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:43:25.039087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:25.039087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:43:25.039087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:43:25.039087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:43:25.039087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:43:25.039087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:43:25.039087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:43:25.039087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:43:25.039087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:43:25.039087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6d360341-449d-4b49-8b66-a02a969171fd could not be found. May 25 07:43:25.039087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:25.039087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:25.039087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:25.039087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:25.039087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:25.039087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:25.039087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:43:25.039087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:43:25.039087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:43:25.040284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:43:25.040284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:43:25.040284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:43:25.040284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:43:25.040284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:43:25.040284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:43:25.040284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:43:25.040284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6d360341-449d-4b49-8b66-a02a969171fd could not be found. May 25 07:43:25.040284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:25.040284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:25.040284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:25.040284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:25.040284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:25.040284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:25.040284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:43:25.040284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:43:25.040284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6d360341-449d-4b49-8b66-a02a969171fd could not be found. May 25 07:43:25.040284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:43:25.041447 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-b461e678-c4f6-4f39-9984-5bcd0c90f337 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] Returning 404 to user: Instance 6d360341-449d-4b49-8b66-a02a969171fd could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:43:25.041447 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-b461e678-c4f6-4f39-9984-5bcd0c90f337 tempest-AttachVolumeShelveTestJSON-605607613 tempest-AttachVolumeShelveTestJSON-605607613-project] 10.222.0.24 "GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd" status: 404 len: 111 microversion: 2.20 time: 0.030169 May 25 07:43:25.041447 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 411/861] 10.222.0.24 () {60 vars in 1276 bytes} [Wed May 25 07:43:25 2022] GET /compute/v2.1/servers/6d360341-449d-4b49-8b66-a02a969171fd => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) May 25 07:43:27.679285 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-31c5d9ba-aaee-4ce4-8d56-ace3e5ded51a tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] Calling method '.version_select at 0x7fc8643a4790>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:27.731514 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-31c5d9ba-aaee-4ce4-8d56-ace3e5ded51a tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/4e915090-cb2d-4be0-ad92-dcb3ed22ec3f" status: 200 len: 351 microversion: 2.1 time: 0.054662 May 25 07:43:27.731514 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 451/862] 10.222.0.24 () {58 vars in 1244 bytes} [Wed May 25 07:43:27 2022] GET /compute/v2.1/os-volumes/4e915090-cb2d-4be0-ad92-dcb3ed22ec3f => generated 351 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:43:31.024030 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-fe8af939-3e4e-4b80-8374-c9a0274cc930 tempest-VolumesGetTestJSON-603392299 tempest-VolumesGetTestJSON-603392299-project] Action: 'create', calling method: .version_select at 0x7fc864293a60>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-197429640", "metadata": {"Type": "work"}}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:43:31.399406 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-98dddf1f-a729-4957-b8ad-3581d8b57ae0 tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] Calling method '.version_select at 0x7fc8643d4dc0>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:31.447453 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-98dddf1f-a729-4957-b8ad-3581d8b57ae0 tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/38a36faf-47bd-408d-a015-57d7f5aabe76" status: 200 len: 351 microversion: 2.1 time: 0.052462 May 25 07:43:31.454318 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 452/863] 10.222.0.24 () {58 vars in 1244 bytes} [Wed May 25 07:43:31 2022] GET /compute/v2.1/os-volumes/38a36faf-47bd-408d-a015-57d7f5aabe76 => generated 351 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:43:31.727255 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-fe8af939-3e4e-4b80-8374-c9a0274cc930 tempest-VolumesGetTestJSON-603392299 tempest-VolumesGetTestJSON-603392299-project] 10.222.0.24 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.820737 May 25 07:43:31.727878 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 412/864] 10.222.0.24 () {60 vars in 1155 bytes} [Wed May 25 07:43:30 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 822 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) May 25 07:43:31.743132 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-752c2b5e-a66e-4605-808a-fd1fa7f1991e tempest-VolumesGetTestJSON-603392299 tempest-VolumesGetTestJSON-603392299-project] Calling method '.version_select at 0x7fc86438b550>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:31.811077 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-752c2b5e-a66e-4605-808a-fd1fa7f1991e tempest-VolumesGetTestJSON-603392299 tempest-VolumesGetTestJSON-603392299-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/1bad0ad9-765b-40fe-a0de-620a00c171ea" status: 200 len: 352 microversion: 2.1 time: 0.073202 May 25 07:43:31.811688 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 453/865] 10.222.0.24 () {58 vars in 1244 bytes} [Wed May 25 07:43:31 2022] GET /compute/v2.1/os-volumes/1bad0ad9-765b-40fe-a0de-620a00c171ea => generated 352 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:43:32.825279 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1b3c7416-c559-40ba-aeda-b530a4f3420f tempest-VolumesGetTestJSON-603392299 tempest-VolumesGetTestJSON-603392299-project] Calling method '.version_select at 0x7fc8641471f0>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:32.880402 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-1b3c7416-c559-40ba-aeda-b530a4f3420f tempest-VolumesGetTestJSON-603392299 tempest-VolumesGetTestJSON-603392299-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/1bad0ad9-765b-40fe-a0de-620a00c171ea" status: 200 len: 353 microversion: 2.1 time: 0.060679 May 25 07:43:32.881001 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 413/866] 10.222.0.24 () {58 vars in 1244 bytes} [Wed May 25 07:43:32 2022] GET /compute/v2.1/os-volumes/1bad0ad9-765b-40fe-a0de-620a00c171ea => generated 353 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:43:32.893954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-809531b3-ece5-4ae3-a7fb-785a4040bff7 tempest-VolumesGetTestJSON-603392299 tempest-VolumesGetTestJSON-603392299-project] Calling method '.version_select at 0x7fc8641b9ee0>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:32.977463 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-809531b3-ece5-4ae3-a7fb-785a4040bff7 tempest-VolumesGetTestJSON-603392299 tempest-VolumesGetTestJSON-603392299-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/1bad0ad9-765b-40fe-a0de-620a00c171ea" status: 200 len: 353 microversion: 2.1 time: 0.088280 May 25 07:43:32.978799 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 454/867] 10.222.0.24 () {58 vars in 1244 bytes} [Wed May 25 07:43:32 2022] GET /compute/v2.1/os-volumes/1bad0ad9-765b-40fe-a0de-620a00c171ea => generated 353 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:43:33.007420 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-a5a3b62e-6412-4e96-ab29-b74d400ab4aa tempest-VolumesGetTestJSON-603392299 tempest-VolumesGetTestJSON-603392299-project] Calling method '.version_select at 0x7fc8641b2820>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:33.261899 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ff683f85-2c36-43cb-95f8-e6fd4aaa415b tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] Calling method '.version_select at 0x7fc8643d44c0>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:33.326070 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-a5a3b62e-6412-4e96-ab29-b74d400ab4aa tempest-VolumesGetTestJSON-603392299 tempest-VolumesGetTestJSON-603392299-project] 10.222.0.24 "DELETE /compute/v2.1/os-volumes/1bad0ad9-765b-40fe-a0de-620a00c171ea" status: 202 len: 0 microversion: 2.1 time: 0.323119 May 25 07:43:33.330679 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 414/868] 10.222.0.24 () {58 vars in 1247 bytes} [Wed May 25 07:43:32 2022] DELETE /compute/v2.1/os-volumes/1bad0ad9-765b-40fe-a0de-620a00c171ea => generated 0 bytes in 327 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:43:33.337743 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-f78bcd3f-bc37-44b7-b04f-43468becdf10 tempest-VolumesGetTestJSON-603392299 tempest-VolumesGetTestJSON-603392299-project] Calling method '.version_select at 0x7fc864175ca0>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:33.350525 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ff683f85-2c36-43cb-95f8-e6fd4aaa415b tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/1b7e712d-836a-4841-82c6-08408b750e75" status: 200 len: 351 microversion: 2.1 time: 0.093588 May 25 07:43:33.361147 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 455/869] 10.222.0.24 () {58 vars in 1244 bytes} [Wed May 25 07:43:33 2022] GET /compute/v2.1/os-volumes/1b7e712d-836a-4841-82c6-08408b750e75 => generated 351 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:43:33.382237 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-992506e2-6051-4f29-8783-142454ba4b2b tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] Calling method '.version_select at 0x7fc864168430>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:33.463736 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-f78bcd3f-bc37-44b7-b04f-43468becdf10 tempest-VolumesGetTestJSON-603392299 tempest-VolumesGetTestJSON-603392299-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/1bad0ad9-765b-40fe-a0de-620a00c171ea" status: 200 len: 352 microversion: 2.1 time: 0.130929 May 25 07:43:33.469557 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 415/870] 10.222.0.24 () {58 vars in 1244 bytes} [Wed May 25 07:43:33 2022] GET /compute/v2.1/os-volumes/1bad0ad9-765b-40fe-a0de-620a00c171ea => generated 352 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:43:33.517788 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-992506e2-6051-4f29-8783-142454ba4b2b tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.154235 May 25 07:43:33.519088 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 456/871] 10.222.0.24 () {58 vars in 1133 bytes} [Wed May 25 07:43:33 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:33.532245 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7bb84d37-1e49-46fb-a3d1-57a6f0b903c3 tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] Calling method '.version_select at 0x7fc864293c10>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:33.693603 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-7bb84d37-1e49-46fb-a3d1-57a6f0b903c3 tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.165662 May 25 07:43:33.694692 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 416/872] 10.222.0.24 () {58 vars in 1148 bytes} [Wed May 25 07:43:33 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:43:33.708597 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-849b07d4-e476-4646-a58f-481351208a0d tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] Calling method '.version_select at 0x7fc86438b430>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:33.840279 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-849b07d4-e476-4646-a58f-481351208a0d tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] 10.222.0.24 "GET /compute/v2.1/os-volumes" status: 200 len: 1036 microversion: 2.1 time: 0.135485 May 25 07:43:33.841237 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 457/873] 10.222.0.24 () {58 vars in 1133 bytes} [Wed May 25 07:43:33 2022] GET /compute/v2.1/os-volumes => generated 1036 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:33.854197 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-53b307e9-40d1-4a4e-824d-21fac8220e36 tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] Calling method '.version_select at 0x7fc8641b2dc0>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:33.953424 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-53b307e9-40d1-4a4e-824d-21fac8220e36 tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] 10.222.0.24 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.103364 May 25 07:43:33.954959 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 417/874] 10.222.0.24 () {58 vars in 1166 bytes} [Wed May 25 07:43:33 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:43:33.967147 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-5e5e9b35-f4bd-497a-a145-7eccd72a00f8 tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] Calling method '.version_select at 0x7fc864320820>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:34.065916 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-5e5e9b35-f4bd-497a-a145-7eccd72a00f8 tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.102999 May 25 07:43:34.074608 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 458/875] 10.222.0.24 () {58 vars in 1169 bytes} [Wed May 25 07:43:33 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:43:34.080470 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-df2dc1b2-acae-499d-afb4-1e5a37d2d509 tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] Calling method '.version_select at 0x7fc8641b2af0>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:34.205709 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-df2dc1b2-acae-499d-afb4-1e5a37d2d509 tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.130174 May 25 07:43:34.206432 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 418/876] 10.222.0.24 () {58 vars in 1154 bytes} [Wed May 25 07:43:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:43:34.224148 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-776d5b95-2b5f-4e78-b98b-47eab375586d tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] Calling method '.version_select at 0x7fc8643d4c10>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:34.346259 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-776d5b95-2b5f-4e78-b98b-47eab375586d tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.132147 May 25 07:43:34.353616 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 459/877] 10.222.0.24 () {58 vars in 1187 bytes} [Wed May 25 07:43:34 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:43:34.360453 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-3deddd25-b2c4-4ffb-815c-b74cc17fe262 tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] Calling method '.version_select at 0x7fc864293c10>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:34.461984 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-3deddd25-b2c4-4ffb-815c-b74cc17fe262 tempest-VolumesTestJSON-1025145653 tempest-VolumesTestJSON-1025145653-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1036 microversion: 2.1 time: 0.106807 May 25 07:43:34.476773 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 419/878] 10.222.0.24 () {58 vars in 1154 bytes} [Wed May 25 07:43:34 2022] GET /compute/v2.1/os-volumes/detail => generated 1036 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:43:34.483504 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a5c60f5a-6658-4369-9d57-90f34dba9b7c tempest-VolumesGetTestJSON-603392299 tempest-VolumesGetTestJSON-603392299-project] Calling method '.version_select at 0x7fc864176f70>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:43:34.537490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-a5c60f5a-6658-4369-9d57-90f34dba9b7c tempest-VolumesGetTestJSON-603392299 tempest-VolumesGetTestJSON-603392299-project] HTTP exception thrown: Volume 1bad0ad9-765b-40fe-a0de-620a00c171ea could not be found. May 25 07:43:34.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a5c60f5a-6658-4369-9d57-90f34dba9b7c tempest-VolumesGetTestJSON-603392299 tempest-VolumesGetTestJSON-603392299-project] Request method failure captured: May 25 07:43:34.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: GET /compute/v2.1/os-volumes/1bad0ad9-765b-40fe-a0de-620a00c171ea HTTP/1.1 May 25 07:43:34.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:43:34.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:43:34.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:43:34.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:43:34.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:43:34.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:43:34.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:43:34.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:43:34.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijd4iD0exhvfPymkMcgJnb2A_NSH1A7FPLAyeruamygLn1jc55l2TKVO1nzCC03NO1vuaMKXD_9Ts2y9Xr-a5YZFHumoNJBsr7RvuCy_69AE_JVpy-3dkRBS8ukJSYvE21r-Lr1Nc7oACr5G4rgzfC3jYkX5pLXUHuVI36cQc2EFiNY8 May 25 07:43:34.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:43:34.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:43:34.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:43:34.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:43:34.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:43:34.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:43:34.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: 286bb5fd6a634b21a7d42a8eed4c61b0 May 25 07:43:34.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-VolumesGetTestJSON-603392299 May 25 07:43:34.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:43:34.539161 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:43:34.540618 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/286bb5fd6a634b21a7d42a8eed4c61b0"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/286bb5fd6a634b21a7d42a8eed4c61b0"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_286bb5fd6a634b21a7d42a8eed4c61b0", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/286bb5fd6a634b21a7d42a8eed4c61b0"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:43:34.540618 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-VolumesGetTestJSON-603392299 May 25 07:43:34.540618 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: 286bb5fd6a634b21a7d42a8eed4c61b0 May 25 07:43:34.540618 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-VolumesGetTestJSON-603392299 May 25 07:43:34.540618 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-VolumesGetTestJSON-603392299-project May 25 07:43:34.540618 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:43:34.540618 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:43:34.540618 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: 98fb77f4c1ca4a7fbc5d9d8c75f9e74b May 25 07:43:34.540618 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-VolumesGetTestJSON-603392299-project May 25 07:43:34.540618 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: May 25 07:43:34.540618 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Volume 1bad0ad9-765b-40fe-a0de-620a00c171ea could not be found. May 25 07:43:34.540618 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': '1bad0ad9-765b-40fe-a0de-620a00c171ea'} May 25 07:43:34.540618 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:43:34.541535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:34.541535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 07:43:34.541535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 07:43:34.541535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 07:43:34.541535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 07:43:34.541535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 07:43:34.541535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 07:43:34.541535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 07:43:34.541535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 07:43:34.541535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 07:43:34.541535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 07:43:34.541535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 07:43:34.541535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 07:43:34.541535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 07:43:34.541535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 07:43:34.541535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 1bad0ad9-765b-40fe-a0de-620a00c171ea could not be found. (HTTP 404) (Request-ID: req-60068c51-24b8-41e8-8bde-80c577e1e238) May 25 07:43:34.541535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:34.541535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:34.541535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:34.543486 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:34.543486 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show May 25 07:43:34.543486 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) May 25 07:43:34.543486 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper May 25 07:43:34.543486 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) May 25 07:43:34.543486 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper May 25 07:43:34.543486 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) May 25 07:43:34.543486 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise May 25 07:43:34.543486 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) May 25 07:43:34.543486 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper May 25 07:43:34.543486 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) May 25 07:43:34.543486 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get May 25 07:43:34.543486 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi item = cinderclient( May 25 07:43:34.543486 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get May 25 07:43:34.543486 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") May 25 07:43:34.543486 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get May 25 07:43:34.543486 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) May 25 07:43:34.543486 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get May 25 07:43:34.543486 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) May 25 07:43:34.545654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request May 25 07:43:34.545654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) May 25 07:43:34.545654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request May 25 07:43:34.545654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) May 25 07:43:34.545654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 1bad0ad9-765b-40fe-a0de-620a00c171ea could not be found. May 25 07:43:34.545654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:34.545654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:34.545654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:34.545654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:34.545654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:34.545654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:34.545654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:43:34.545654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:43:34.545654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select May 25 07:43:34.545654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) May 25 07:43:34.545654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:43:34.545654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:43:34.545654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show May 25 07:43:34.545654 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:43:34.548146 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 1bad0ad9-765b-40fe-a0de-620a00c171ea could not be found. May 25 07:43:34.548146 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:34.548146 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:43:34.548146 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:34.548146 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:43:34.548146 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:43:34.548146 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:43:34.548146 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:43:34.548146 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:43:34.548146 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 1bad0ad9-765b-40fe-a0de-620a00c171ea could not be found. May 25 07:43:34.548146 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:43:34.548146 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a5c60f5a-6658-4369-9d57-90f34dba9b7c tempest-VolumesGetTestJSON-603392299 tempest-VolumesGetTestJSON-603392299-project] Returning 404 to user: Volume 1bad0ad9-765b-40fe-a0de-620a00c171ea could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:43:34.548146 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a5c60f5a-6658-4369-9d57-90f34dba9b7c tempest-VolumesGetTestJSON-603392299 tempest-VolumesGetTestJSON-603392299-project] 10.222.0.24 "GET /compute/v2.1/os-volumes/1bad0ad9-765b-40fe-a0de-620a00c171ea" status: 404 len: 109 microversion: 2.1 time: 0.068232 May 25 07:43:34.548146 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 460/879] 10.222.0.24 () {58 vars in 1244 bytes} [Wed May 25 07:43:34 2022] GET /compute/v2.1/os-volumes/1bad0ad9-765b-40fe-a0de-620a00c171ea => generated 109 bytes in 73 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:44:06.669593 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:06.670445 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=7 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:06.675129 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-63b467f6-be96-4c26-86db-64b0fd5c2e21 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-846485412", "imageRef": "ddc5b622-a846-425a-b8fd-7e5caef00bf8", "flavorRef": "452", "networks": [{"uuid": "c3acec61-ced6-4aa4-9c0d-e8c3f6579c19"}]}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:44:06.727426 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.network.neutron [None req-63b467f6-be96-4c26-86db-64b0fd5c2e21 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] validate_networks() for [('c3acec61-ced6-4aa4-9c0d-e8c3f6579c19', None, None, None, None, None)] {{(pid=124674) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:44:07.082621 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-63b467f6-be96-4c26-86db-64b0fd5c2e21 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Flavor limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:44:07.083049 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-63b467f6-be96-4c26-86db-64b0fd5c2e21 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Image limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:44:07.083521 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-63b467f6-be96-4c26-86db-64b0fd5c2e21 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Flavor pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:44:07.083926 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-63b467f6-be96-4c26-86db-64b0fd5c2e21 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Image pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:44:07.084359 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-63b467f6-be96-4c26-86db-64b0fd5c2e21 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:44:07.093152 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-63b467f6-be96-4c26-86db-64b0fd5c2e21 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:07.093600 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-63b467f6-be96-4c26-86db-64b0fd5c2e21 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:07.094389 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-63b467f6-be96-4c26-86db-64b0fd5c2e21 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:07.095010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-63b467f6-be96-4c26-86db-64b0fd5c2e21 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:07.111838 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-63b467f6-be96-4c26-86db-64b0fd5c2e21 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Getting quotas for project ee2590cbdba14e7ab1f3ce5a58beeb54. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:44:07.115968 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-63b467f6-be96-4c26-86db-64b0fd5c2e21 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Getting quotas for user 820809022ed4493eb9f536c3b1fbc878 and project ee2590cbdba14e7ab1f3ce5a58beeb54. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:44:07.127366 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-63b467f6-be96-4c26-86db-64b0fd5c2e21 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Going to run 1 instances... {{(pid=124674) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:44:07.129641 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-63b467f6-be96-4c26-86db-64b0fd5c2e21 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddc5b622-a846-425a-b8fd-7e5caef00bf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:44:07.319537 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-63b467f6-be96-4c26-86db-64b0fd5c2e21 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.651093 May 25 07:44:07.325142 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 420/880] 10.222.0.24 () {60 vars in 1146 bytes} [Wed May 25 07:44:06 2022] POST /compute/v2.1/servers => generated 380 bytes in 653 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 07:44:07.333671 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=53,nova_api:DELETE=2 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:07.333671 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=87 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:07.334511 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-da4dab11-e9b6-48a0-b359-f537834a56b3 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:07.340588 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-da4dab11-e9b6-48a0-b359-f537834a56b3 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:07.427354 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-da4dab11-e9b6-48a0-b359-f537834a56b3 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:44:07.445953 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-da4dab11-e9b6-48a0-b359-f537834a56b3 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585" status: 200 len: 1218 microversion: 2.1 time: 0.111985 May 25 07:44:07.445953 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 461/881] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:44:07 2022] GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 => generated 1218 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:44:08.458618 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-768618c3-8d10-4fe3-acc2-4d1cd63ec265 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:08.461023 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-768618c3-8d10-4fe3-acc2-4d1cd63ec265 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:08.538050 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-768618c3-8d10-4fe3-acc2-4d1cd63ec265 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:44:08.552568 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-768618c3-8d10-4fe3-acc2-4d1cd63ec265 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585" status: 200 len: 1218 microversion: 2.1 time: 0.095431 May 25 07:44:08.562878 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 421/882] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:44:08 2022] GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 => generated 1218 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:44:09.570503 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-023920cb-f60d-4927-9919-16465bb78c39 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:09.584282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-023920cb-f60d-4927-9919-16465bb78c39 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:09.584282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-023920cb-f60d-4927-9919-16465bb78c39 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:09.584282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-023920cb-f60d-4927-9919-16465bb78c39 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:09.584282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-023920cb-f60d-4927-9919-16465bb78c39 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:09.585969 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-023920cb-f60d-4927-9919-16465bb78c39 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:09.655567 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-023920cb-f60d-4927-9919-16465bb78c39 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:44:09.663804 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-023920cb-f60d-4927-9919-16465bb78c39 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585" status: 200 len: 1270 microversion: 2.1 time: 0.097933 May 25 07:44:09.664373 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 462/883] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:44:09 2022] GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 => generated 1270 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:44:10.680518 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-65b6a8aa-7881-406d-99ba-6997b88fabbb tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:10.681337 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-65b6a8aa-7881-406d-99ba-6997b88fabbb tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:10.688035 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-65b6a8aa-7881-406d-99ba-6997b88fabbb tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:10.688618 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-65b6a8aa-7881-406d-99ba-6997b88fabbb tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:10.690201 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-65b6a8aa-7881-406d-99ba-6997b88fabbb tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:10.690645 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-65b6a8aa-7881-406d-99ba-6997b88fabbb tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:10.757053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-65b6a8aa-7881-406d-99ba-6997b88fabbb tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:44:10.764456 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-65b6a8aa-7881-406d-99ba-6997b88fabbb tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585" status: 200 len: 1276 microversion: 2.1 time: 0.087952 May 25 07:44:10.765046 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 422/884] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:44:10 2022] GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 => generated 1276 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:44:11.782142 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-3a6e7a83-d7d4-49ac-b643-309b8a3b9d34 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:11.783653 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-3a6e7a83-d7d4-49ac-b643-309b8a3b9d34 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:11.790908 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3a6e7a83-d7d4-49ac-b643-309b8a3b9d34 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:11.791613 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3a6e7a83-d7d4-49ac-b643-309b8a3b9d34 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:11.792618 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3a6e7a83-d7d4-49ac-b643-309b8a3b9d34 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:11.793055 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3a6e7a83-d7d4-49ac-b643-309b8a3b9d34 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:11.926715 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-3a6e7a83-d7d4-49ac-b643-309b8a3b9d34 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:44:11.943992 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-3a6e7a83-d7d4-49ac-b643-309b8a3b9d34 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585" status: 200 len: 1318 microversion: 2.1 time: 0.165974 May 25 07:44:11.944820 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 463/885] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:44:11 2022] GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 => generated 1318 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:44:12.092339 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-9ccf6b35-ec7f-413b-b99f-d0f01660421c req-d7de425c-9f04-46cc-b3c6-387bfb62677c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "10ed8294-8f3a-4fac-8e9a-c3b78075a585", "tag": "8088516f-f409-4c1a-a818-72e6472926e1"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:44:12.102300 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-9ccf6b35-ec7f-413b-b99f-d0f01660421c req-d7de425c-9f04-46cc-b3c6-387bfb62677c service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:12.108685 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-9ccf6b35-ec7f-413b-b99f-d0f01660421c req-d7de425c-9f04-46cc-b3c6-387bfb62677c service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:12.114499 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-9ccf6b35-ec7f-413b-b99f-d0f01660421c req-d7de425c-9f04-46cc-b3c6-387bfb62677c service nova] Creating event network-changed:8088516f-f409-4c1a-a818-72e6472926e1 for instance 10ed8294-8f3a-4fac-8e9a-c3b78075a585 on hv-cinder-82549 May 25 07:44:12.119936 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-9ccf6b35-ec7f-413b-b99f-d0f01660421c req-d7de425c-9f04-46cc-b3c6-387bfb62677c service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031433 May 25 07:44:12.120932 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 423/886] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:44:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:44:12.966990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4a06ab85-50ab-41f0-afd3-f78de7ea3518 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:12.973034 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4a06ab85-50ab-41f0-afd3-f78de7ea3518 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:12.975881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4a06ab85-50ab-41f0-afd3-f78de7ea3518 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:12.976419 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4a06ab85-50ab-41f0-afd3-f78de7ea3518 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:12.977480 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4a06ab85-50ab-41f0-afd3-f78de7ea3518 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:12.978064 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4a06ab85-50ab-41f0-afd3-f78de7ea3518 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:13.132487 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4a06ab85-50ab-41f0-afd3-f78de7ea3518 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:44:13.140328 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4a06ab85-50ab-41f0-afd3-f78de7ea3518 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585" status: 200 len: 1318 microversion: 2.1 time: 0.177358 May 25 07:44:13.140951 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 464/887] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:44:12 2022] GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 => generated 1318 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:44:14.159526 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-437fc504-caa2-44ae-9939-da2904a3e919 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:14.160241 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-437fc504-caa2-44ae-9939-da2904a3e919 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:14.166696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-437fc504-caa2-44ae-9939-da2904a3e919 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:14.167157 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-437fc504-caa2-44ae-9939-da2904a3e919 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:14.167932 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-437fc504-caa2-44ae-9939-da2904a3e919 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:14.168379 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-437fc504-caa2-44ae-9939-da2904a3e919 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:14.305710 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-437fc504-caa2-44ae-9939-da2904a3e919 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:44:14.314060 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-437fc504-caa2-44ae-9939-da2904a3e919 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585" status: 200 len: 1318 microversion: 2.1 time: 0.160142 May 25 07:44:14.314775 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 424/888] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:44:14 2022] GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 => generated 1318 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:44:15.331314 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ec485f0e-d12c-41d3-9cd4-c83df9292be2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:15.331858 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ec485f0e-d12c-41d3-9cd4-c83df9292be2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:15.338055 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ec485f0e-d12c-41d3-9cd4-c83df9292be2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:15.338514 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ec485f0e-d12c-41d3-9cd4-c83df9292be2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:15.339284 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ec485f0e-d12c-41d3-9cd4-c83df9292be2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:15.339728 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ec485f0e-d12c-41d3-9cd4-c83df9292be2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:15.468364 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ec485f0e-d12c-41d3-9cd4-c83df9292be2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:44:15.476641 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ec485f0e-d12c-41d3-9cd4-c83df9292be2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585" status: 200 len: 1318 microversion: 2.1 time: 0.149516 May 25 07:44:15.477240 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 465/889] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:44:15 2022] GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:44:16.493669 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-67a34450-9364-41b9-bb49-3bfc6ac78527 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:16.494320 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-67a34450-9364-41b9-bb49-3bfc6ac78527 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:16.500914 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-67a34450-9364-41b9-bb49-3bfc6ac78527 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:16.501316 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-67a34450-9364-41b9-bb49-3bfc6ac78527 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:16.502896 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-67a34450-9364-41b9-bb49-3bfc6ac78527 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:16.503340 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-67a34450-9364-41b9-bb49-3bfc6ac78527 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:16.636576 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-67a34450-9364-41b9-bb49-3bfc6ac78527 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:44:16.645188 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-67a34450-9364-41b9-bb49-3bfc6ac78527 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585" status: 200 len: 1318 microversion: 2.1 time: 0.155565 May 25 07:44:16.646128 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 425/890] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:44:16 2022] GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:44:17.659710 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=2 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:17.664461 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a71cc58b-08d6-4276-8891-fc2bfb32350d tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:17.665116 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a71cc58b-08d6-4276-8891-fc2bfb32350d tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:17.672204 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a71cc58b-08d6-4276-8891-fc2bfb32350d tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:17.672704 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a71cc58b-08d6-4276-8891-fc2bfb32350d tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:17.674371 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a71cc58b-08d6-4276-8891-fc2bfb32350d tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:17.674964 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a71cc58b-08d6-4276-8891-fc2bfb32350d tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:17.821663 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a71cc58b-08d6-4276-8891-fc2bfb32350d tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:44:17.829111 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a71cc58b-08d6-4276-8891-fc2bfb32350d tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585" status: 200 len: 1318 microversion: 2.1 time: 0.171166 May 25 07:44:17.829674 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 466/891] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:44:17 2022] GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 => generated 1318 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:44:18.846781 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-88b633ed-6a79-4f11-ab6a-37dec404fa44 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:18.847320 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-88b633ed-6a79-4f11-ab6a-37dec404fa44 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:18.849270 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=2 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:18.850415 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=8 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:18.855264 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-88b633ed-6a79-4f11-ab6a-37dec404fa44 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:18.855711 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-88b633ed-6a79-4f11-ab6a-37dec404fa44 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:18.856470 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-88b633ed-6a79-4f11-ab6a-37dec404fa44 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:18.856926 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-88b633ed-6a79-4f11-ab6a-37dec404fa44 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:18.984032 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-88b633ed-6a79-4f11-ab6a-37dec404fa44 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:44:18.992425 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-88b633ed-6a79-4f11-ab6a-37dec404fa44 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585" status: 200 len: 1318 microversion: 2.1 time: 0.149618 May 25 07:44:18.993024 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 426/892] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:44:18 2022] GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 => generated 1318 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:44:20.009398 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-cc2d822a-a519-4911-a0f7-b52cdda8ee34 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:20.010019 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-cc2d822a-a519-4911-a0f7-b52cdda8ee34 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:20.016594 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cc2d822a-a519-4911-a0f7-b52cdda8ee34 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:20.017053 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cc2d822a-a519-4911-a0f7-b52cdda8ee34 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:20.017829 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cc2d822a-a519-4911-a0f7-b52cdda8ee34 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:20.018851 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-cc2d822a-a519-4911-a0f7-b52cdda8ee34 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:20.149310 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-cc2d822a-a519-4911-a0f7-b52cdda8ee34 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:44:20.156775 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-cc2d822a-a519-4911-a0f7-b52cdda8ee34 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585" status: 200 len: 1318 microversion: 2.1 time: 0.151248 May 25 07:44:20.157377 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 467/893] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:44:20 2022] GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:44:21.016602 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-226c22ec-ad12-4fd5-b237-d2fea7b2ebf7 req-0f98f31c-679c-4a4d-8cd6-a1ea3d2774b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ed8294-8f3a-4fac-8e9a-c3b78075a585", "name": "network-vif-plugged", "status": "completed", "tag": "8088516f-f409-4c1a-a818-72e6472926e1"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:44:21.028406 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-226c22ec-ad12-4fd5-b237-d2fea7b2ebf7 req-0f98f31c-679c-4a4d-8cd6-a1ea3d2774b1 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:21.029169 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-226c22ec-ad12-4fd5-b237-d2fea7b2ebf7 req-0f98f31c-679c-4a4d-8cd6-a1ea3d2774b1 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:21.043135 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-226c22ec-ad12-4fd5-b237-d2fea7b2ebf7 req-0f98f31c-679c-4a4d-8cd6-a1ea3d2774b1 service nova] Creating event network-vif-plugged:8088516f-f409-4c1a-a818-72e6472926e1 for instance 10ed8294-8f3a-4fac-8e9a-c3b78075a585 on hv-cinder-82549 May 25 07:44:21.047955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-226c22ec-ad12-4fd5-b237-d2fea7b2ebf7 req-0f98f31c-679c-4a4d-8cd6-a1ea3d2774b1 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035114 May 25 07:44:21.048688 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 427/894] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:44:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:44:21.174063 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-f4c2aacf-b33d-4c58-8b63-ffc9cf5aa1e2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:21.174685 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-f4c2aacf-b33d-4c58-8b63-ffc9cf5aa1e2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:21.181878 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f4c2aacf-b33d-4c58-8b63-ffc9cf5aa1e2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:21.182336 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f4c2aacf-b33d-4c58-8b63-ffc9cf5aa1e2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:21.183105 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f4c2aacf-b33d-4c58-8b63-ffc9cf5aa1e2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:21.183562 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f4c2aacf-b33d-4c58-8b63-ffc9cf5aa1e2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:21.319196 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-f4c2aacf-b33d-4c58-8b63-ffc9cf5aa1e2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:44:21.326579 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-f4c2aacf-b33d-4c58-8b63-ffc9cf5aa1e2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585" status: 200 len: 1318 microversion: 2.1 time: 0.156553 May 25 07:44:21.327135 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 468/895] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:44:21 2022] GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:44:22.344999 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-cd8fdabd-e91a-4fde-9ef7-967afe95c740 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:22.345773 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-cd8fdabd-e91a-4fde-9ef7-967afe95c740 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:22.354854 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cd8fdabd-e91a-4fde-9ef7-967afe95c740 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:22.355386 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cd8fdabd-e91a-4fde-9ef7-967afe95c740 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:22.356234 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cd8fdabd-e91a-4fde-9ef7-967afe95c740 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:22.356774 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cd8fdabd-e91a-4fde-9ef7-967afe95c740 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:22.518712 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-cd8fdabd-e91a-4fde-9ef7-967afe95c740 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:44:22.526846 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-cd8fdabd-e91a-4fde-9ef7-967afe95c740 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585" status: 200 len: 1318 microversion: 2.1 time: 0.186772 May 25 07:44:22.527412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 428/896] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:44:22 2022] GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 => generated 1318 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:44:23.543692 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-400b988c-f977-4e3e-9172-d924daaeb59e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:23.544405 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-400b988c-f977-4e3e-9172-d924daaeb59e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:23.550984 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-400b988c-f977-4e3e-9172-d924daaeb59e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:23.552672 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-400b988c-f977-4e3e-9172-d924daaeb59e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:23.552790 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-400b988c-f977-4e3e-9172-d924daaeb59e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:23.553241 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-400b988c-f977-4e3e-9172-d924daaeb59e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:23.735762 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-400b988c-f977-4e3e-9172-d924daaeb59e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:44:23.744207 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-400b988c-f977-4e3e-9172-d924daaeb59e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585" status: 200 len: 1506 microversion: 2.1 time: 0.204656 May 25 07:44:23.744829 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 469/897] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:44:23 2022] GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 => generated 1506 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:44:35.778080 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d4300622-8d22-4515-b4a9-b77ef194dc83 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:35.778633 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d4300622-8d22-4515-b4a9-b77ef194dc83 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:35.780954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:35.783264 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=20 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:35.784000 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=36 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:35.784109 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=48 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:44:35.786876 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d4300622-8d22-4515-b4a9-b77ef194dc83 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:35.787563 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d4300622-8d22-4515-b4a9-b77ef194dc83 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:35.788903 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d4300622-8d22-4515-b4a9-b77ef194dc83 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:35.789558 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d4300622-8d22-4515-b4a9-b77ef194dc83 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:35.829243 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d4300622-8d22-4515-b4a9-b77ef194dc83 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Going to try to terminate instance {{(pid=124674) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:44:35.946320 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-5fdbc6bb-bc97-4ecd-86f2-fed3fa542648 req-8e7a0bb0-4107-4eee-a6fe-7dd19264ce9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "63430b83-f298-430c-9ca9-bdd4d69bde91", "tag": "6d5abc91-52ce-441e-be4e-749082dec7ae"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:44:35.958083 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-5fdbc6bb-bc97-4ecd-86f2-fed3fa542648 req-8e7a0bb0-4107-4eee-a6fe-7dd19264ce9d service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:35.958083 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-5fdbc6bb-bc97-4ecd-86f2-fed3fa542648 req-8e7a0bb0-4107-4eee-a6fe-7dd19264ce9d service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:35.972018 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-5fdbc6bb-bc97-4ecd-86f2-fed3fa542648 req-8e7a0bb0-4107-4eee-a6fe-7dd19264ce9d service nova] Creating event network-changed:6d5abc91-52ce-441e-be4e-749082dec7ae for instance 63430b83-f298-430c-9ca9-bdd4d69bde91 on hv-cinder-82549 May 25 07:44:35.978651 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-5fdbc6bb-bc97-4ecd-86f2-fed3fa542648 req-8e7a0bb0-4107-4eee-a6fe-7dd19264ce9d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.201966 May 25 07:44:35.984429 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 470/898] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:44:35 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:44:36.298280 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d4300622-8d22-4515-b4a9-b77ef194dc83 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "DELETE /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 204 len: 0 microversion: 2.1 time: 0.524087 May 25 07:44:36.299252 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 429/899] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:44:35 2022] DELETE /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 0 bytes in 526 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 07:44:36.309120 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-eeda3508-0ada-4654-a9d3-7a0845cde1f9 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:36.309829 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-eeda3508-0ada-4654-a9d3-7a0845cde1f9 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:36.316170 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eeda3508-0ada-4654-a9d3-7a0845cde1f9 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:36.316666 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eeda3508-0ada-4654-a9d3-7a0845cde1f9 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:36.317669 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eeda3508-0ada-4654-a9d3-7a0845cde1f9 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:36.318359 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eeda3508-0ada-4654-a9d3-7a0845cde1f9 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:36.486701 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-eeda3508-0ada-4654-a9d3-7a0845cde1f9 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:44:36.495001 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-eeda3508-0ada-4654-a9d3-7a0845cde1f9 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1568 microversion: 2.1 time: 0.190965 May 25 07:44:36.495590 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 471/900] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:44:36 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1568 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:44:37.620454 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-3c89c94c-b342-42d6-a2e1-82d5fab7749e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:37.623833 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-3c89c94c-b342-42d6-a2e1-82d5fab7749e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:37.627128 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3c89c94c-b342-42d6-a2e1-82d5fab7749e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:37.627575 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3c89c94c-b342-42d6-a2e1-82d5fab7749e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:37.628335 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3c89c94c-b342-42d6-a2e1-82d5fab7749e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:37.628795 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3c89c94c-b342-42d6-a2e1-82d5fab7749e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:37.813438 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-3c89c94c-b342-42d6-a2e1-82d5fab7749e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:44:37.821487 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-3c89c94c-b342-42d6-a2e1-82d5fab7749e tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1568 microversion: 2.1 time: 0.312564 May 25 07:44:37.822164 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 430/901] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:44:37 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1568 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:44:38.839105 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-fdf8559a-e959-46dd-b75c-8f1ccb08c178 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:38.839726 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-fdf8559a-e959-46dd-b75c-8f1ccb08c178 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:38.846317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fdf8559a-e959-46dd-b75c-8f1ccb08c178 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:38.851045 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fdf8559a-e959-46dd-b75c-8f1ccb08c178 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:38.851045 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fdf8559a-e959-46dd-b75c-8f1ccb08c178 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:38.851045 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fdf8559a-e959-46dd-b75c-8f1ccb08c178 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:39.010110 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-fdf8559a-e959-46dd-b75c-8f1ccb08c178 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:44:39.010110 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-fdf8559a-e959-46dd-b75c-8f1ccb08c178 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1449 microversion: 2.1 time: 0.174481 May 25 07:44:39.010773 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 472/902] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:44:38 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1449 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:44:39.033426 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-bf9b8372-ae7e-47a5-9b45-c6f2bf631260 req-f85b96a0-3b14-4053-9841-b4a5f6cce0c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "63430b83-f298-430c-9ca9-bdd4d69bde91", "name": "network-vif-deleted", "tag": "6d5abc91-52ce-441e-be4e-749082dec7ae"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:44:39.037582 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-bf9b8372-ae7e-47a5-9b45-c6f2bf631260 req-f85b96a0-3b14-4053-9841-b4a5f6cce0c5 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:39.038716 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-bf9b8372-ae7e-47a5-9b45-c6f2bf631260 req-f85b96a0-3b14-4053-9841-b4a5f6cce0c5 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:39.050001 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-bf9b8372-ae7e-47a5-9b45-c6f2bf631260 req-f85b96a0-3b14-4053-9841-b4a5f6cce0c5 service nova] Creating event network-vif-deleted:6d5abc91-52ce-441e-be4e-749082dec7ae for instance 63430b83-f298-430c-9ca9-bdd4d69bde91 on hv-cinder-82549 May 25 07:44:39.057831 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-bf9b8372-ae7e-47a5-9b45-c6f2bf631260 req-f85b96a0-3b14-4053-9841-b4a5f6cce0c5 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033900 May 25 07:44:39.064660 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 431/903] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:44:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:44:40.028907 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-e95cabfd-b1bb-4b1e-a85c-3c1af2033a63 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:40.030297 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-e95cabfd-b1bb-4b1e-a85c-3c1af2033a63 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:40.038262 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e95cabfd-b1bb-4b1e-a85c-3c1af2033a63 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:40.039533 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e95cabfd-b1bb-4b1e-a85c-3c1af2033a63 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:40.041641 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e95cabfd-b1bb-4b1e-a85c-3c1af2033a63 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:40.042355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e95cabfd-b1bb-4b1e-a85c-3c1af2033a63 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:40.395174 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-e95cabfd-b1bb-4b1e-a85c-3c1af2033a63 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:44:40.408690 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-e95cabfd-b1bb-4b1e-a85c-3c1af2033a63 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1219 microversion: 2.1 time: 0.384413 May 25 07:44:40.418608 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 473/904] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:44:40 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1219 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:44:41.427831 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-e39a5ddc-40d8-4544-8f84-fb3096fe87bf tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:41.429344 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-e39a5ddc-40d8-4544-8f84-fb3096fe87bf tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:41.437840 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e39a5ddc-40d8-4544-8f84-fb3096fe87bf tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:41.438299 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e39a5ddc-40d8-4544-8f84-fb3096fe87bf tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:41.439079 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e39a5ddc-40d8-4544-8f84-fb3096fe87bf tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:41.439821 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e39a5ddc-40d8-4544-8f84-fb3096fe87bf tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:41.483120 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e39a5ddc-40d8-4544-8f84-fb3096fe87bf tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:41.483752 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-e39a5ddc-40d8-4544-8f84-fb3096fe87bf tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:41.484208 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.objects.instance [None req-e39a5ddc-40d8-4544-8f84-fb3096fe87bf tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lazy-loading 'fault' on Instance uuid 63430b83-f298-430c-9ca9-bdd4d69bde91 {{(pid=124674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:44:41.533691 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-e39a5ddc-40d8-4544-8f84-fb3096fe87bf tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f3cd1d48ead14854a5f9f532efcc1e62', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f13c4f9ee9c444d9b9a0d2c2e3ec9142', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:44:41.563578 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-e39a5ddc-40d8-4544-8f84-fb3096fe87bf tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 200 len: 1224 microversion: 2.1 time: 0.140500 May 25 07:44:41.564174 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 432/905] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:44:41 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 1224 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:44:42.581328 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-572a4421-9bb5-4a3e-a918-d482ec8fd3b2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:42.582529 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-572a4421-9bb5-4a3e-a918-d482ec8fd3b2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] [instance: 63430b83-f298-430c-9ca9-bdd4d69bde91] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:42.589829 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-572a4421-9bb5-4a3e-a918-d482ec8fd3b2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:42.590288 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-572a4421-9bb5-4a3e-a918-d482ec8fd3b2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:42.591078 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-572a4421-9bb5-4a3e-a918-d482ec8fd3b2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:42.591525 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-572a4421-9bb5-4a3e-a918-d482ec8fd3b2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:42.605665 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-572a4421-9bb5-4a3e-a918-d482ec8fd3b2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] HTTP exception thrown: Instance 63430b83-f298-430c-9ca9-bdd4d69bde91 could not be found. May 25 07:44:42.607330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-572a4421-9bb5-4a3e-a918-d482ec8fd3b2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Request method failure captured: May 25 07:44:42.607330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 HTTP/1.1 May 25 07:44:42.607330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:44:42.607330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:44:42.607330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:44:42.607330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:44:42.607330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:44:42.607330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:44:42.607330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:44:42.607330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:44:42.607330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijd0vavS7IaUw4kMILO4vZ1jJpDUmRg_aALAflEsRbtB-Zrv-Jx8bieSVwQiEeBHziPOVB4kmSPZWzkki00Lae_wzOmzXtzf5CrY_82VC4Hl6FBd-Eo7zRkI5OZIgy2-TAJyWZreBJVqFzbj2LG4PLNtR9IoEgN8CwioLV263mGtYiR8 May 25 07:44:42.607330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:44:42.607330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:44:42.607330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:44:42.607330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:44:42.607330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:44:42.607330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:44:42.607330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: f13c4f9ee9c444d9b9a0d2c2e3ec9142 May 25 07:44:42.607330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-TestShelveInstance-2091076447 May 25 07:44:42.607330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:44:42.607330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:44:42.609037 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f13c4f9ee9c444d9b9a0d2c2e3ec9142"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/f13c4f9ee9c444d9b9a0d2c2e3ec9142"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_f13c4f9ee9c444d9b9a0d2c2e3ec9142", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f13c4f9ee9c444d9b9a0d2c2e3ec9142"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:44:42.609037 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-TestShelveInstance-2091076447 May 25 07:44:42.609037 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: f13c4f9ee9c444d9b9a0d2c2e3ec9142 May 25 07:44:42.609037 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-TestShelveInstance-2091076447 May 25 07:44:42.609037 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-TestShelveInstance-2091076447-project May 25 07:44:42.609037 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:44:42.609037 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:44:42.609037 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: f3cd1d48ead14854a5f9f532efcc1e62 May 25 07:44:42.609037 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-TestShelveInstance-2091076447-project May 25 07:44:42.609037 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:44:42.609037 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance 63430b83-f298-430c-9ca9-bdd4d69bde91 could not be found. May 25 07:44:42.609037 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': '63430b83-f298-430c-9ca9-bdd4d69bde91'} May 25 07:44:42.609990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:44:42.609990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:44:42.609990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:44:42.609990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:44:42.609990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:44:42.609990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:44:42.609990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:44:42.609990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:44:42.609990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:44:42.609990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:44:42.609990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 63430b83-f298-430c-9ca9-bdd4d69bde91 could not be found. May 25 07:44:42.609990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:44:42.609990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:44:42.609990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:44:42.609990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:44:42.609990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:44:42.609990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:44:42.609990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:44:42.609990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:44:42.609990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:44:42.611629 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:44:42.611629 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:44:42.611629 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:44:42.611629 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:44:42.611629 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:44:42.611629 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:44:42.611629 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:44:42.611629 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 63430b83-f298-430c-9ca9-bdd4d69bde91 could not be found. May 25 07:44:42.611629 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:44:42.611629 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:44:42.611629 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:44:42.611629 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:44:42.611629 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:44:42.611629 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:44:42.611629 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:44:42.611629 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:44:42.611629 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 63430b83-f298-430c-9ca9-bdd4d69bde91 could not be found. May 25 07:44:42.611629 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:44:42.613060 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-572a4421-9bb5-4a3e-a918-d482ec8fd3b2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Returning 404 to user: Instance 63430b83-f298-430c-9ca9-bdd4d69bde91 could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:44:42.613060 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-572a4421-9bb5-4a3e-a918-d482ec8fd3b2 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91" status: 404 len: 111 microversion: 2.1 time: 0.031509 May 25 07:44:42.613060 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 474/906] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:44:42 2022] GET /compute/v2.1/servers/63430b83-f298-430c-9ca9-bdd4d69bde91 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:44:43.180247 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-65641dd1-ae89-4e1c-a64d-ec5157d6d969 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] Calling method '.version_select at 0x7fc864263ca0>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:44:43.283053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-65641dd1-ae89-4e1c-a64d-ec5157d6d969 tempest-TestShelveInstance-2091076447 tempest-TestShelveInstance-2091076447-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2078716448" status: 202 len: 0 microversion: 2.1 time: 0.108256 May 25 07:44:43.283673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 433/907] 10.222.0.24 () {58 vars in 1253 bytes} [Wed May 25 07:44:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-2078716448 => generated 0 bytes in 110 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:44:51.044044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-83c7bc5e-6699-4bde-af26-d9f7a7acab6a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "790192d7-aba3-47b3-99d7-e4dc928076ad", "device": "/dev/sdb"}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:44:51.047015 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-83c7bc5e-6699-4bde-af26-d9f7a7acab6a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:44:51.054658 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-83c7bc5e-6699-4bde-af26-d9f7a7acab6a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:51.055716 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-83c7bc5e-6699-4bde-af26-d9f7a7acab6a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:51.056541 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-83c7bc5e-6699-4bde-af26-d9f7a7acab6a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:44:51.056992 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-83c7bc5e-6699-4bde-af26-d9f7a7acab6a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:44:51.907972 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-83c7bc5e-6699-4bde-af26-d9f7a7acab6a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "POST /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.870527 May 25 07:44:51.908680 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 475/908] 10.222.0.24 () {60 vars in 1322 bytes} [Wed May 25 07:44:51 2022] POST /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585/os-volume_attachments => generated 194 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:45:10.308770 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=30,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:10.312700 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=18,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:10.607408 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-a67a20fc-48cb-48e8-a229-5b16061af938 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Action: 'create', calling method: .version_select at 0x7fc8643624c0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1927951084", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLWpoK7sBQE4y+1ux2+uYtxzVK9N6p4Xo/cmzPYZVfusTqjzmZpItgRZZX6TH2+pFvSs/JADtBWPcjmnGzIbauQeI+xt8/hXdGen8BZmIw5Ayeh1n+Oc8j8FYTP8kJV/IQ=="}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:45:10.627344 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-a67a20fc-48cb-48e8-a229-5b16061af938 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Getting quotas for project f5e67d0f06be415794efd436655904b3. Resources: {'key_pairs'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:45:10.631780 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-a67a20fc-48cb-48e8-a229-5b16061af938 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Getting quotas for user d3d92c0c69cf470e8aecb57e79e5a7fe and project f5e67d0f06be415794efd436655904b3. Resources: {'key_pairs'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:45:10.809642 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-a67a20fc-48cb-48e8-a229-5b16061af938 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.502500 May 25 07:45:10.810301 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 434/909] 10.222.0.24 () {60 vars in 1158 bytes} [Wed May 25 07:45:10 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:45:18.649428 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=12 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:18.650232 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:18.654627 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4b675b54-cfcf-4672-a130-ac8045533262 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:18.655041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4b675b54-cfcf-4672-a130-ac8045533262 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:18.666871 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4b675b54-cfcf-4672-a130-ac8045533262 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:18.669016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4b675b54-cfcf-4672-a130-ac8045533262 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:18.671216 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4b675b54-cfcf-4672-a130-ac8045533262 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:18.671674 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4b675b54-cfcf-4672-a130-ac8045533262 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:18.803854 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.objects.instance [None req-4b675b54-cfcf-4672-a130-ac8045533262 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lazy-loading 'services' on Instance uuid 10ed8294-8f3a-4fac-8e9a-c3b78075a585 {{(pid=124675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:45:19.126897 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4b675b54-cfcf-4672-a130-ac8045533262 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "DELETE /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585/os-volume_attachments/790192d7-aba3-47b3-99d7-e4dc928076ad" status: 202 len: 0 microversion: 2.1 time: 0.479137 May 25 07:45:19.128025 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 476/910] 10.222.0.24 () {58 vars in 1415 bytes} [Wed May 25 07:45:18 2022] DELETE /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585/os-volume_attachments/790192d7-aba3-47b3-99d7-e4dc928076ad => generated 0 bytes in 481 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:45:21.449197 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=4 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:21.455772 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-69ce6c46-d8bc-4eba-8b53-35137f3aa582 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:21.459255 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-69ce6c46-d8bc-4eba-8b53-35137f3aa582 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:21.467477 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-69ce6c46-d8bc-4eba-8b53-35137f3aa582 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:21.470908 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-69ce6c46-d8bc-4eba-8b53-35137f3aa582 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:21.472003 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-69ce6c46-d8bc-4eba-8b53-35137f3aa582 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:21.472711 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-69ce6c46-d8bc-4eba-8b53-35137f3aa582 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:21.510270 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-69ce6c46-d8bc-4eba-8b53-35137f3aa582 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Going to try to terminate instance {{(pid=124674) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:45:21.875389 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-69ce6c46-d8bc-4eba-8b53-35137f3aa582 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "DELETE /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585" status: 204 len: 0 microversion: 2.1 time: 0.428163 May 25 07:45:21.876101 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 435/911] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:45:21 2022] DELETE /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 => generated 0 bytes in 430 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 07:45:21.893147 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4a59c2e9-a75c-4ca6-b25b-5742dd2830f9 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:21.899079 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4a59c2e9-a75c-4ca6-b25b-5742dd2830f9 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:21.903316 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4a59c2e9-a75c-4ca6-b25b-5742dd2830f9 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:21.903951 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4a59c2e9-a75c-4ca6-b25b-5742dd2830f9 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:21.904980 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4a59c2e9-a75c-4ca6-b25b-5742dd2830f9 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:21.905797 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4a59c2e9-a75c-4ca6-b25b-5742dd2830f9 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:22.084573 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4a59c2e9-a75c-4ca6-b25b-5742dd2830f9 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:22.102837 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4a59c2e9-a75c-4ca6-b25b-5742dd2830f9 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585" status: 200 len: 1512 microversion: 2.1 time: 0.219999 May 25 07:45:22.104502 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 477/912] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:21 2022] GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 => generated 1512 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:23.122574 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-5d6775b1-082d-4246-8819-060ddc5c4171 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:23.123330 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-5d6775b1-082d-4246-8819-060ddc5c4171 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:23.131523 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5d6775b1-082d-4246-8819-060ddc5c4171 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:23.132293 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5d6775b1-082d-4246-8819-060ddc5c4171 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:23.134153 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5d6775b1-082d-4246-8819-060ddc5c4171 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:23.134813 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5d6775b1-082d-4246-8819-060ddc5c4171 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:23.297144 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-5d6775b1-082d-4246-8819-060ddc5c4171 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:23.309926 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-5d6775b1-082d-4246-8819-060ddc5c4171 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585" status: 200 len: 1512 microversion: 2.1 time: 0.191761 May 25 07:45:23.316915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 436/913] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:23 2022] GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 => generated 1512 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:24.329382 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-61c33733-10d7-472e-ab11-1db59f610011 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:24.330319 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-61c33733-10d7-472e-ab11-1db59f610011 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:24.343066 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-61c33733-10d7-472e-ab11-1db59f610011 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:24.343639 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-61c33733-10d7-472e-ab11-1db59f610011 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:24.344775 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-61c33733-10d7-472e-ab11-1db59f610011 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:24.345408 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-61c33733-10d7-472e-ab11-1db59f610011 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:24.389108 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-003143a6-086a-4bfc-b4bd-ca49324eb255 req-ee7b3299-d017-4f22-b4fe-de3f82982606 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "10ed8294-8f3a-4fac-8e9a-c3b78075a585", "name": "network-vif-deleted", "tag": "8088516f-f409-4c1a-a818-72e6472926e1"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:45:24.401136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-003143a6-086a-4bfc-b4bd-ca49324eb255 req-ee7b3299-d017-4f22-b4fe-de3f82982606 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:24.401584 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-003143a6-086a-4bfc-b4bd-ca49324eb255 req-ee7b3299-d017-4f22-b4fe-de3f82982606 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:24.425584 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-003143a6-086a-4bfc-b4bd-ca49324eb255 req-ee7b3299-d017-4f22-b4fe-de3f82982606 service nova] Creating event network-vif-deleted:8088516f-f409-4c1a-a818-72e6472926e1 for instance 10ed8294-8f3a-4fac-8e9a-c3b78075a585 on hv-cinder-82549 May 25 07:45:24.437926 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-61c33733-10d7-472e-ab11-1db59f610011 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:24.439736 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-003143a6-086a-4bfc-b4bd-ca49324eb255 req-ee7b3299-d017-4f22-b4fe-de3f82982606 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054794 May 25 07:45:24.443187 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 437/914] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:45:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:45:24.452249 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-61c33733-10d7-472e-ab11-1db59f610011 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585" status: 200 len: 1470 microversion: 2.1 time: 0.128975 May 25 07:45:24.453304 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 478/915] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:24 2022] GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 => generated 1470 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:25.471051 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-0aaa14fb-ce7d-458d-a206-d3da6e55e67f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:25.471760 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-0aaa14fb-ce7d-458d-a206-d3da6e55e67f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:25.479706 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0aaa14fb-ce7d-458d-a206-d3da6e55e67f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:25.480446 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0aaa14fb-ce7d-458d-a206-d3da6e55e67f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:25.481352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0aaa14fb-ce7d-458d-a206-d3da6e55e67f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:25.481805 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0aaa14fb-ce7d-458d-a206-d3da6e55e67f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:25.523207 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0aaa14fb-ce7d-458d-a206-d3da6e55e67f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:25.523808 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0aaa14fb-ce7d-458d-a206-d3da6e55e67f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:25.524265 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.objects.instance [None req-0aaa14fb-ce7d-458d-a206-d3da6e55e67f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lazy-loading 'fault' on Instance uuid 10ed8294-8f3a-4fac-8e9a-c3b78075a585 {{(pid=124674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:45:25.570434 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-0aaa14fb-ce7d-458d-a206-d3da6e55e67f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:25.578256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-0aaa14fb-ce7d-458d-a206-d3da6e55e67f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585" status: 200 len: 1308 microversion: 2.1 time: 0.111419 May 25 07:45:25.656957 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 438/916] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:25 2022] GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 => generated 1308 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:26.595168 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-00128840-6c49-4d6e-a0ca-a3149f203a0b tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:26.595940 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-00128840-6c49-4d6e-a0ca-a3149f203a0b tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 10ed8294-8f3a-4fac-8e9a-c3b78075a585] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:26.603063 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-00128840-6c49-4d6e-a0ca-a3149f203a0b tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:26.604310 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-00128840-6c49-4d6e-a0ca-a3149f203a0b tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:26.604310 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-00128840-6c49-4d6e-a0ca-a3149f203a0b tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:26.604730 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-00128840-6c49-4d6e-a0ca-a3149f203a0b tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:26.618891 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-00128840-6c49-4d6e-a0ca-a3149f203a0b tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] HTTP exception thrown: Instance 10ed8294-8f3a-4fac-8e9a-c3b78075a585 could not be found. May 25 07:45:26.620569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-00128840-6c49-4d6e-a0ca-a3149f203a0b tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Request method failure captured: May 25 07:45:26.620569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 HTTP/1.1 May 25 07:45:26.620569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:45:26.620569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:45:26.620569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:45:26.620569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:45:26.620569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:45:26.620569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:45:26.620569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:45:26.620569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:45:26.620569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijd5CvTV22RdhHLfOcB0db3JVCFfPfwOrSe04l6cjpEuDl3trWxbYz6rBdEaTSRtZImWz7ctBmiE0PUQNRm3jfBq6LPtONHJ1ROY9JyJ6hVr6mCHxss2eJmF6h7oF1bSmWGoJK4_1Ac73WJj2n1XoiOm03e4HgkFMIQiwHaW9S1gbVgI May 25 07:45:26.620569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:45:26.620569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:45:26.620569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:45:26.620569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:45:26.620569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:45:26.620569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:45:26.620569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: ee2590cbdba14e7ab1f3ce5a58beeb54 May 25 07:45:26.620569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1886078946 May 25 07:45:26.620569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:45:26.620569 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:45:26.622404 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ee2590cbdba14e7ab1f3ce5a58beeb54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ee2590cbdba14e7ab1f3ce5a58beeb54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ee2590cbdba14e7ab1f3ce5a58beeb54", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ee2590cbdba14e7ab1f3ce5a58beeb54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:45:26.622404 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-VolumesSnapshotTestJSON-1886078946 May 25 07:45:26.622404 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: ee2590cbdba14e7ab1f3ce5a58beeb54 May 25 07:45:26.622404 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1886078946 May 25 07:45:26.622404 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-VolumesSnapshotTestJSON-1886078946-project May 25 07:45:26.622404 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:45:26.622404 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:45:26.622404 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: 820809022ed4493eb9f536c3b1fbc878 May 25 07:45:26.622404 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-VolumesSnapshotTestJSON-1886078946-project May 25 07:45:26.622404 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:45:26.622404 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance 10ed8294-8f3a-4fac-8e9a-c3b78075a585 could not be found. May 25 07:45:26.622404 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': '10ed8294-8f3a-4fac-8e9a-c3b78075a585'} May 25 07:45:26.623344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:45:26.623344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:45:26.623344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:45:26.623344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:45:26.623344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:45:26.623344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:45:26.623344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:45:26.623344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:45:26.623344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:45:26.623344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:45:26.623344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 10ed8294-8f3a-4fac-8e9a-c3b78075a585 could not be found. May 25 07:45:26.623344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:45:26.623344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:45:26.623344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:45:26.623344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:45:26.623344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:45:26.623344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:45:26.623344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:45:26.623344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:45:26.623344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:45:26.624752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:45:26.624752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:45:26.624752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:45:26.624752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:45:26.624752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:45:26.624752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:45:26.624752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:45:26.624752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 10ed8294-8f3a-4fac-8e9a-c3b78075a585 could not be found. May 25 07:45:26.624752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:45:26.624752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:45:26.624752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:45:26.624752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:45:26.624752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:45:26.624752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:45:26.624752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:45:26.624752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:45:26.624752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 10ed8294-8f3a-4fac-8e9a-c3b78075a585 could not be found. May 25 07:45:26.624752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:45:26.625986 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-00128840-6c49-4d6e-a0ca-a3149f203a0b tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Returning 404 to user: Instance 10ed8294-8f3a-4fac-8e9a-c3b78075a585 could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:45:26.625986 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-00128840-6c49-4d6e-a0ca-a3149f203a0b tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585" status: 404 len: 111 microversion: 2.1 time: 0.030671 May 25 07:45:26.625986 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 479/917] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:26 2022] GET /compute/v2.1/servers/10ed8294-8f3a-4fac-8e9a-c3b78075a585 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:45:26.724973 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c03cfb1d-fa83-4535-bd78-a350ee3456c6 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Action: 'create', calling method: .version_select at 0x7fc8642f1430>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-11457544", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNot+hERSuy0htOCdyObB1tMcXDz6Y2ADfN8LsXgZGo71xBc5DoqRf1/hOedGfbvm6375mPendxc9jFXHAWoOO8YLo/l4vQL0g0w0kjsYdtNgVhQAoN7puJxUx69sjw6Kw=="}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:45:26.739973 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-c03cfb1d-fa83-4535-bd78-a350ee3456c6 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Getting quotas for project ce3e8f3592894606afc4d35c82d8f36f. Resources: {'key_pairs'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:45:26.744822 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-c03cfb1d-fa83-4535-bd78-a350ee3456c6 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Getting quotas for user b003492ec6a8434fb778f017b07e8697 and project ce3e8f3592894606afc4d35c82d8f36f. Resources: {'key_pairs'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:45:26.824764 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c03cfb1d-fa83-4535-bd78-a350ee3456c6 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "POST /compute/v2.1/os-keypairs" status: 200 len: 401 microversion: 2.1 time: 0.103721 May 25 07:45:26.825365 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 439/918] 10.222.0.24 () {60 vars in 1158 bytes} [Wed May 25 07:45:26 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:45:26.877815 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-fe5a7856-cbe0-41d8-b566-8f427d939b6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-2140282052", "imageRef": "5395cb54-2e0d-4222-85df-5813ab22cafe", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-11457544", "networks": [{"uuid": "1f9a3bff-e0aa-4277-a6ad-8da29c0b0d1a"}]}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:45:26.931694 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.network.neutron [None req-fe5a7856-cbe0-41d8-b566-8f427d939b6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] validate_networks() for [('1f9a3bff-e0aa-4277-a6ad-8da29c0b0d1a', None, None, None, None, None)] {{(pid=124675) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:45:27.581386 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-fe5a7856-cbe0-41d8-b566-8f427d939b6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Flavor limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:45:27.581811 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-fe5a7856-cbe0-41d8-b566-8f427d939b6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Image limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:45:27.582307 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-fe5a7856-cbe0-41d8-b566-8f427d939b6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Flavor pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:45:27.582716 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-fe5a7856-cbe0-41d8-b566-8f427d939b6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Image pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:45:27.583134 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-fe5a7856-cbe0-41d8-b566-8f427d939b6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:45:27.592929 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fe5a7856-cbe0-41d8-b566-8f427d939b6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:27.593535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fe5a7856-cbe0-41d8-b566-8f427d939b6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:27.594336 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fe5a7856-cbe0-41d8-b566-8f427d939b6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:27.594772 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fe5a7856-cbe0-41d8-b566-8f427d939b6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:27.612025 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-fe5a7856-cbe0-41d8-b566-8f427d939b6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Getting quotas for project ce3e8f3592894606afc4d35c82d8f36f. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:45:27.616614 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-fe5a7856-cbe0-41d8-b566-8f427d939b6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Getting quotas for user b003492ec6a8434fb778f017b07e8697 and project ce3e8f3592894606afc4d35c82d8f36f. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:45:27.627720 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-fe5a7856-cbe0-41d8-b566-8f427d939b6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Going to run 1 instances... {{(pid=124675) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:45:27.629972 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-fe5a7856-cbe0-41d8-b566-8f427d939b6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='5395cb54-2e0d-4222-85df-5813ab22cafe',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:45:27.751693 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-fe5a7856-cbe0-41d8-b566-8f427d939b6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.877906 May 25 07:45:27.752344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 480/919] 10.222.0.24 () {60 vars in 1146 bytes} [Wed May 25 07:45:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 879 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 07:45:27.763257 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-78384631-0dd4-4968-98bf-6b5bd17ee4de tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:27.763981 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-78384631-0dd4-4968-98bf-6b5bd17ee4de tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:27.817820 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-78384631-0dd4-4968-98bf-6b5bd17ee4de tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:27.827230 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-78384631-0dd4-4968-98bf-6b5bd17ee4de tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1257 microversion: 2.1 time: 0.068192 May 25 07:45:27.827921 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 440/920] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:27 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1257 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:28.846231 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-2be796e3-3867-452a-8914-0d992a8e68ea tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:28.846780 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-2be796e3-3867-452a-8914-0d992a8e68ea tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:28.905065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-2be796e3-3867-452a-8914-0d992a8e68ea tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:28.911833 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-2be796e3-3867-452a-8914-0d992a8e68ea tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1257 microversion: 2.1 time: 0.070173 May 25 07:45:28.912461 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 481/921] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:28 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1257 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:29.929472 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-fcb1b576-d5b5-4d84-bee8-354ed965da13 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:29.930044 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-fcb1b576-d5b5-4d84-bee8-354ed965da13 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:29.937908 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fcb1b576-d5b5-4d84-bee8-354ed965da13 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:29.938503 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fcb1b576-d5b5-4d84-bee8-354ed965da13 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:29.939507 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fcb1b576-d5b5-4d84-bee8-354ed965da13 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:29.939859 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fcb1b576-d5b5-4d84-bee8-354ed965da13 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:30.004461 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-fcb1b576-d5b5-4d84-bee8-354ed965da13 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:30.011975 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-fcb1b576-d5b5-4d84-bee8-354ed965da13 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1261 microversion: 2.1 time: 0.086441 May 25 07:45:30.013238 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 441/922] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:29 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1261 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:31.029238 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-7217ff7a-704f-4a56-bd65-eabc9520d008 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:31.029963 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-7217ff7a-704f-4a56-bd65-eabc9520d008 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:31.036734 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7217ff7a-704f-4a56-bd65-eabc9520d008 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:31.037186 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7217ff7a-704f-4a56-bd65-eabc9520d008 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:31.037964 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7217ff7a-704f-4a56-bd65-eabc9520d008 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:31.038404 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7217ff7a-704f-4a56-bd65-eabc9520d008 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:31.099857 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-7217ff7a-704f-4a56-bd65-eabc9520d008 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:31.107538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-7217ff7a-704f-4a56-bd65-eabc9520d008 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1261 microversion: 2.1 time: 0.082825 May 25 07:45:31.108097 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 482/923] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:31 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1261 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:32.124795 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-53a77662-27d5-4e4e-bf4e-7db3b1fe9e87 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:32.125406 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-53a77662-27d5-4e4e-bf4e-7db3b1fe9e87 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:32.131934 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-53a77662-27d5-4e4e-bf4e-7db3b1fe9e87 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:32.132379 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-53a77662-27d5-4e4e-bf4e-7db3b1fe9e87 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:32.133171 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-53a77662-27d5-4e4e-bf4e-7db3b1fe9e87 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:32.133607 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-53a77662-27d5-4e4e-bf4e-7db3b1fe9e87 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:32.195048 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-53a77662-27d5-4e4e-bf4e-7db3b1fe9e87 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:32.202550 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-53a77662-27d5-4e4e-bf4e-7db3b1fe9e87 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1309 microversion: 2.1 time: 0.081821 May 25 07:45:32.203112 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 442/924] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:32 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1309 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:33.220832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-f5f7e384-072a-4d94-b411-e90a0a72fa21 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:33.221466 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-f5f7e384-072a-4d94-b411-e90a0a72fa21 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:33.227729 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f5f7e384-072a-4d94-b411-e90a0a72fa21 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:33.228191 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f5f7e384-072a-4d94-b411-e90a0a72fa21 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:33.229186 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f5f7e384-072a-4d94-b411-e90a0a72fa21 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:33.229650 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f5f7e384-072a-4d94-b411-e90a0a72fa21 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:33.292348 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-f5f7e384-072a-4d94-b411-e90a0a72fa21 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:33.302916 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-f5f7e384-072a-4d94-b411-e90a0a72fa21 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1315 microversion: 2.1 time: 0.086219 May 25 07:45:33.303765 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 483/925] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:33 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1315 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:34.323520 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-fad7c852-12c6-4913-b396-adad2783afa9 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:34.324192 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-fad7c852-12c6-4913-b396-adad2783afa9 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:34.340451 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fad7c852-12c6-4913-b396-adad2783afa9 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:34.341201 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fad7c852-12c6-4913-b396-adad2783afa9 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:34.345587 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fad7c852-12c6-4913-b396-adad2783afa9 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:34.345587 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-fad7c852-12c6-4913-b396-adad2783afa9 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:34.528303 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-94850b24-e61f-495e-8051-1222c7a0d522 req-5ab86bdc-f7e9-40ef-a143-e3b2982dc87f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "892bc459-4577-4e8c-b87f-04861e9f1ea8", "tag": "eed8a0c9-0f18-40ef-a65e-38b52e79aa6e"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:45:34.550013 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-94850b24-e61f-495e-8051-1222c7a0d522 req-5ab86bdc-f7e9-40ef-a143-e3b2982dc87f service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:34.559103 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-94850b24-e61f-495e-8051-1222c7a0d522 req-5ab86bdc-f7e9-40ef-a143-e3b2982dc87f service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:34.594832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-94850b24-e61f-495e-8051-1222c7a0d522 req-5ab86bdc-f7e9-40ef-a143-e3b2982dc87f service nova] Creating event network-changed:eed8a0c9-0f18-40ef-a65e-38b52e79aa6e for instance 892bc459-4577-4e8c-b87f-04861e9f1ea8 on hv-cinder-82549 May 25 07:45:34.607099 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-94850b24-e61f-495e-8051-1222c7a0d522 req-5ab86bdc-f7e9-40ef-a143-e3b2982dc87f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.083566 May 25 07:45:34.609150 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 484/926] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:45:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:45:34.609682 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-fad7c852-12c6-4913-b396-adad2783afa9 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:34.619404 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-fad7c852-12c6-4913-b396-adad2783afa9 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1357 microversion: 2.1 time: 0.301164 May 25 07:45:34.620290 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 443/927] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:34 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1357 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:45:35.638937 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-dcea1123-501f-4b52-9150-af17aba2cf6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:35.639622 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-dcea1123-501f-4b52-9150-af17aba2cf6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:35.650990 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dcea1123-501f-4b52-9150-af17aba2cf6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:35.651557 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dcea1123-501f-4b52-9150-af17aba2cf6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:35.652612 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dcea1123-501f-4b52-9150-af17aba2cf6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:35.653058 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-dcea1123-501f-4b52-9150-af17aba2cf6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:35.823927 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-dcea1123-501f-4b52-9150-af17aba2cf6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:35.832444 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-dcea1123-501f-4b52-9150-af17aba2cf6e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1357 microversion: 2.1 time: 0.197828 May 25 07:45:35.833616 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 485/928] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:35 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1357 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:36.850081 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7a3e08d2-d2c8-4b6d-ba05-a69946e0a5a2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:36.850675 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-7a3e08d2-d2c8-4b6d-ba05-a69946e0a5a2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:36.858321 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7a3e08d2-d2c8-4b6d-ba05-a69946e0a5a2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:36.858876 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7a3e08d2-d2c8-4b6d-ba05-a69946e0a5a2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:36.859662 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7a3e08d2-d2c8-4b6d-ba05-a69946e0a5a2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:36.860097 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7a3e08d2-d2c8-4b6d-ba05-a69946e0a5a2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:37.000780 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7a3e08d2-d2c8-4b6d-ba05-a69946e0a5a2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:37.008626 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-7a3e08d2-d2c8-4b6d-ba05-a69946e0a5a2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1357 microversion: 2.1 time: 0.162518 May 25 07:45:37.009545 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 444/929] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:36 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:38.027721 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-7416cd1b-3380-43e4-a7cf-f9d61fe8cedd tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:38.028784 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-7416cd1b-3380-43e4-a7cf-f9d61fe8cedd tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:38.033355 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=2 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:38.038768 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7416cd1b-3380-43e4-a7cf-f9d61fe8cedd tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:38.039423 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7416cd1b-3380-43e4-a7cf-f9d61fe8cedd tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:38.040293 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7416cd1b-3380-43e4-a7cf-f9d61fe8cedd tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:38.040715 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-7416cd1b-3380-43e4-a7cf-f9d61fe8cedd tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:38.199323 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-7416cd1b-3380-43e4-a7cf-f9d61fe8cedd tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:38.211036 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-7416cd1b-3380-43e4-a7cf-f9d61fe8cedd tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1357 microversion: 2.1 time: 0.187817 May 25 07:45:38.212093 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 486/930] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:38 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1357 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:39.229718 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-95a044de-1b2f-47a7-9721-eb0b0cc5740e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:39.230471 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-95a044de-1b2f-47a7-9721-eb0b0cc5740e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:39.233346 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=6 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:39.240374 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-95a044de-1b2f-47a7-9721-eb0b0cc5740e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:39.240976 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-95a044de-1b2f-47a7-9721-eb0b0cc5740e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:39.243009 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-95a044de-1b2f-47a7-9721-eb0b0cc5740e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:39.243453 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-95a044de-1b2f-47a7-9721-eb0b0cc5740e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:39.391249 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-9130e4dc-ed82-445f-bad0-c56e4e66c70f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1388234535", "imageRef": "ddc5b622-a846-425a-b8fd-7e5caef00bf8", "flavorRef": "452", "networks": [{"uuid": "c3acec61-ced6-4aa4-9c0d-e8c3f6579c19"}]}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:45:39.398521 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=8 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:39.405003 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-95a044de-1b2f-47a7-9721-eb0b0cc5740e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:39.416010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-95a044de-1b2f-47a7-9721-eb0b0cc5740e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1357 microversion: 2.1 time: 0.190071 May 25 07:45:39.417197 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 445/931] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:39 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1357 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:39.462331 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.network.neutron [None req-9130e4dc-ed82-445f-bad0-c56e4e66c70f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] validate_networks() for [('c3acec61-ced6-4aa4-9c0d-e8c3f6579c19', None, None, None, None, None)] {{(pid=124675) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:45:39.917921 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-9130e4dc-ed82-445f-bad0-c56e4e66c70f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Flavor limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:45:39.918567 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-9130e4dc-ed82-445f-bad0-c56e4e66c70f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Image limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:45:39.919388 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-9130e4dc-ed82-445f-bad0-c56e4e66c70f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Flavor pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:45:39.920605 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-9130e4dc-ed82-445f-bad0-c56e4e66c70f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Image pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:45:39.921213 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-9130e4dc-ed82-445f-bad0-c56e4e66c70f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:45:39.933050 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9130e4dc-ed82-445f-bad0-c56e4e66c70f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:39.936686 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9130e4dc-ed82-445f-bad0-c56e4e66c70f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:39.936686 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9130e4dc-ed82-445f-bad0-c56e4e66c70f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:39.936686 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9130e4dc-ed82-445f-bad0-c56e4e66c70f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:39.953117 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-9130e4dc-ed82-445f-bad0-c56e4e66c70f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Getting quotas for project ee2590cbdba14e7ab1f3ce5a58beeb54. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:45:39.957376 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-9130e4dc-ed82-445f-bad0-c56e4e66c70f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Getting quotas for user 820809022ed4493eb9f536c3b1fbc878 and project ee2590cbdba14e7ab1f3ce5a58beeb54. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:45:39.970967 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-9130e4dc-ed82-445f-bad0-c56e4e66c70f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Going to run 1 instances... {{(pid=124675) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:45:39.973337 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-9130e4dc-ed82-445f-bad0-c56e4e66c70f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='ddc5b622-a846-425a-b8fd-7e5caef00bf8',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=124675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:45:40.213917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-9130e4dc-ed82-445f-bad0-c56e4e66c70f tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.826630 May 25 07:45:40.224650 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 487/932] 10.222.0.24 () {60 vars in 1146 bytes} [Wed May 25 07:45:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 838 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 07:45:40.225911 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-cf7de602-6cc9-4b6d-92d3-09ab72495e90 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:40.226740 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-cf7de602-6cc9-4b6d-92d3-09ab72495e90 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:40.311531 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-cf7de602-6cc9-4b6d-92d3-09ab72495e90 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:40.321957 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-cf7de602-6cc9-4b6d-92d3-09ab72495e90 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a" status: 200 len: 1219 microversion: 2.1 time: 0.099663 May 25 07:45:40.323077 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 446/933] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:40 2022] GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a => generated 1219 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:45:40.435066 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-33214d85-6625-49dc-8679-a32add0eac43 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:40.436778 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-33214d85-6625-49dc-8679-a32add0eac43 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:40.451284 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-33214d85-6625-49dc-8679-a32add0eac43 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:40.454534 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-33214d85-6625-49dc-8679-a32add0eac43 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:40.454534 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-33214d85-6625-49dc-8679-a32add0eac43 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:40.454534 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-33214d85-6625-49dc-8679-a32add0eac43 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:40.643854 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-33214d85-6625-49dc-8679-a32add0eac43 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:40.651917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-33214d85-6625-49dc-8679-a32add0eac43 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1357 microversion: 2.1 time: 0.221170 May 25 07:45:40.662657 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 488/934] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:40 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1357 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:40.896904 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-4d8d230e-5ade-4042-9480-898b314b6b9d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-337084120", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1927951084", "security_groups": [{"name": "tempest-secgroup-smoke-2067050148"}], "block_device_mapping_v2": [{"uuid": "51d403cc-8a57-42ad-b3c2-8324db43ae76", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9bcd68e9-0045-4b34-8142-bf28d91642fb"}]}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:45:41.036638 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.network.neutron [None req-4d8d230e-5ade-4042-9480-898b314b6b9d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] validate_networks() for [('9bcd68e9-0045-4b34-8142-bf28d91642fb', None, None, None, None, None)] {{(pid=124674) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:45:41.339560 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ae704b0c-4028-46d9-bf1b-48af15fd65d8 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:41.340332 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ae704b0c-4028-46d9-bf1b-48af15fd65d8 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:41.354242 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ae704b0c-4028-46d9-bf1b-48af15fd65d8 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:41.354775 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ae704b0c-4028-46d9-bf1b-48af15fd65d8 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:41.355636 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ae704b0c-4028-46d9-bf1b-48af15fd65d8 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:41.356149 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ae704b0c-4028-46d9-bf1b-48af15fd65d8 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:41.452046 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ae704b0c-4028-46d9-bf1b-48af15fd65d8 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:41.460148 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ae704b0c-4028-46d9-bf1b-48af15fd65d8 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a" status: 200 len: 1223 microversion: 2.1 time: 0.124515 May 25 07:45:41.472974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 489/935] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:41 2022] GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a => generated 1223 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:45:41.505083 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-4d8d230e-5ade-4042-9480-898b314b6b9d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Flavor limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:45:41.505626 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-4d8d230e-5ade-4042-9480-898b314b6b9d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Image limits 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:45:41.505959 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-4d8d230e-5ade-4042-9480-898b314b6b9d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Flavor pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:45:41.506361 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-4d8d230e-5ade-4042-9480-898b314b6b9d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Image pref 0:0:0 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:45:41.506770 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.virt.hardware [None req-4d8d230e-5ade-4042-9480-898b314b6b9d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124674) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:45:41.516071 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4d8d230e-5ade-4042-9480-898b314b6b9d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:41.516544 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4d8d230e-5ade-4042-9480-898b314b6b9d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:41.517343 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4d8d230e-5ade-4042-9480-898b314b6b9d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:41.517788 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4d8d230e-5ade-4042-9480-898b314b6b9d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:41.535890 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-4d8d230e-5ade-4042-9480-898b314b6b9d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Getting quotas for project f5e67d0f06be415794efd436655904b3. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:45:41.539879 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.quota [None req-4d8d230e-5ade-4042-9480-898b314b6b9d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Getting quotas for user d3d92c0c69cf470e8aecb57e79e5a7fe and project f5e67d0f06be415794efd436655904b3. Resources: {'cores', 'instances', 'ram'} {{(pid=124674) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:45:41.614104 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-4d8d230e-5ade-4042-9480-898b314b6b9d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Going to run 1 instances... {{(pid=124674) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:45:41.616988 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-4d8d230e-5ade-4042-9480-898b314b6b9d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='51d403cc-8a57-42ad-b3c2-8324db43ae76',volume_size=None,volume_type=None)] {{(pid=124674) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:45:41.670767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-f077dd21-ae2e-494f-9346-0e6d5333754a tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:41.671398 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-f077dd21-ae2e-494f-9346-0e6d5333754a tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:41.677564 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f077dd21-ae2e-494f-9346-0e6d5333754a tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:41.678076 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f077dd21-ae2e-494f-9346-0e6d5333754a tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:41.679069 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f077dd21-ae2e-494f-9346-0e6d5333754a tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:41.679681 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f077dd21-ae2e-494f-9346-0e6d5333754a tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:41.814700 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-f077dd21-ae2e-494f-9346-0e6d5333754a tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:41.822470 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-f077dd21-ae2e-494f-9346-0e6d5333754a tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1357 microversion: 2.1 time: 0.156449 May 25 07:45:41.825750 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 490/936] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:41 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:45:42.002667 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-4d8d230e-5ade-4042-9480-898b314b6b9d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.109624 May 25 07:45:42.003409 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 447/937] 10.222.0.24 () {60 vars in 1146 bytes} [Wed May 25 07:45:40 2022] POST /compute/v2.1/servers => generated 406 bytes in 1111 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 07:45:42.013384 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-948628a6-f7bc-47fc-9eea-6c5269f7a635 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:42.014038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-948628a6-f7bc-47fc-9eea-6c5269f7a635 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:42.070969 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-948628a6-f7bc-47fc-9eea-6c5269f7a635 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:42.077744 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-948628a6-f7bc-47fc-9eea-6c5269f7a635 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1094 microversion: 2.1 time: 0.068290 May 25 07:45:42.078350 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 491/938] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:42 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:42.477831 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-faf24b60-18e5-4e31-a4cb-38b694de700c tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:42.478450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-faf24b60-18e5-4e31-a4cb-38b694de700c tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:42.485470 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-faf24b60-18e5-4e31-a4cb-38b694de700c tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:42.485923 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-faf24b60-18e5-4e31-a4cb-38b694de700c tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:42.486819 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-faf24b60-18e5-4e31-a4cb-38b694de700c tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:42.487259 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-faf24b60-18e5-4e31-a4cb-38b694de700c tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:42.553680 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-faf24b60-18e5-4e31-a4cb-38b694de700c tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:42.559528 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-faf24b60-18e5-4e31-a4cb-38b694de700c tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a" status: 200 len: 1223 microversion: 2.1 time: 0.086167 May 25 07:45:42.560631 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 448/939] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:42 2022] GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:42.840051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4b93f013-d953-4599-b7c1-aae694c7a8e8 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:42.840748 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4b93f013-d953-4599-b7c1-aae694c7a8e8 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:42.849295 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4b93f013-d953-4599-b7c1-aae694c7a8e8 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:42.849764 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4b93f013-d953-4599-b7c1-aae694c7a8e8 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:42.850598 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4b93f013-d953-4599-b7c1-aae694c7a8e8 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:42.851039 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4b93f013-d953-4599-b7c1-aae694c7a8e8 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:43.005166 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4b93f013-d953-4599-b7c1-aae694c7a8e8 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:43.012830 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4b93f013-d953-4599-b7c1-aae694c7a8e8 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1357 microversion: 2.1 time: 0.176745 May 25 07:45:43.013445 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 492/940] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:42 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1357 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:43.093998 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-28f8c79e-0134-4c40-84b4-8a5c2cd0ba85 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:43.094617 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-28f8c79e-0134-4c40-84b4-8a5c2cd0ba85 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:43.102503 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-28f8c79e-0134-4c40-84b4-8a5c2cd0ba85 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:43.102954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-28f8c79e-0134-4c40-84b4-8a5c2cd0ba85 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:43.103823 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-28f8c79e-0134-4c40-84b4-8a5c2cd0ba85 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:43.104352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-28f8c79e-0134-4c40-84b4-8a5c2cd0ba85 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:43.179931 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-28f8c79e-0134-4c40-84b4-8a5c2cd0ba85 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:43.188304 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-28f8c79e-0134-4c40-84b4-8a5c2cd0ba85 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1144 microversion: 2.1 time: 0.098298 May 25 07:45:43.189159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 449/941] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:43 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1144 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:43.580308 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a7c506fd-1d81-4d12-b4df-992f076285fe tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:43.580980 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a7c506fd-1d81-4d12-b4df-992f076285fe tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:43.587659 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a7c506fd-1d81-4d12-b4df-992f076285fe tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:43.588125 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a7c506fd-1d81-4d12-b4df-992f076285fe tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:43.589031 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a7c506fd-1d81-4d12-b4df-992f076285fe tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:43.589476 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a7c506fd-1d81-4d12-b4df-992f076285fe tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:43.651980 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a7c506fd-1d81-4d12-b4df-992f076285fe tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:43.660668 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a7c506fd-1d81-4d12-b4df-992f076285fe tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a" status: 200 len: 1223 microversion: 2.1 time: 0.086751 May 25 07:45:43.661250 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 493/942] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:43 2022] GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:44.029656 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-349a98d7-ac9b-43ff-a796-f067284efbce tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:44.030284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-349a98d7-ac9b-43ff-a796-f067284efbce tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:44.036778 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-349a98d7-ac9b-43ff-a796-f067284efbce tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:44.037230 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-349a98d7-ac9b-43ff-a796-f067284efbce tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:44.037987 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-349a98d7-ac9b-43ff-a796-f067284efbce tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:44.038422 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-349a98d7-ac9b-43ff-a796-f067284efbce tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:44.166334 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-349a98d7-ac9b-43ff-a796-f067284efbce tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:44.174039 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-349a98d7-ac9b-43ff-a796-f067284efbce tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1357 microversion: 2.1 time: 0.148445 May 25 07:45:44.174786 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 450/943] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:44 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:44.206697 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-eb3294ec-ce66-418c-aacf-6eaa9f381538 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:44.207322 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-eb3294ec-ce66-418c-aacf-6eaa9f381538 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:44.213866 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eb3294ec-ce66-418c-aacf-6eaa9f381538 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:44.214327 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eb3294ec-ce66-418c-aacf-6eaa9f381538 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:44.215128 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eb3294ec-ce66-418c-aacf-6eaa9f381538 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:44.215580 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eb3294ec-ce66-418c-aacf-6eaa9f381538 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:44.278673 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-eb3294ec-ce66-418c-aacf-6eaa9f381538 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:44.286585 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-eb3294ec-ce66-418c-aacf-6eaa9f381538 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1144 microversion: 2.1 time: 0.083978 May 25 07:45:44.290767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 494/944] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:44 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1144 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:44.678086 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-f77d6f99-1488-4b9f-8d31-4bc3e4d7b83e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:44.678787 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-f77d6f99-1488-4b9f-8d31-4bc3e4d7b83e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:44.684909 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f77d6f99-1488-4b9f-8d31-4bc3e4d7b83e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:44.685412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f77d6f99-1488-4b9f-8d31-4bc3e4d7b83e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:44.686290 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f77d6f99-1488-4b9f-8d31-4bc3e4d7b83e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:44.686728 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f77d6f99-1488-4b9f-8d31-4bc3e4d7b83e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:44.788557 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-f77d6f99-1488-4b9f-8d31-4bc3e4d7b83e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:44.796803 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-f77d6f99-1488-4b9f-8d31-4bc3e4d7b83e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a" status: 200 len: 1215 microversion: 2.1 time: 0.122737 May 25 07:45:44.802519 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 451/945] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:44 2022] GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a => generated 1215 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:45.192288 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-f18d6297-6654-485b-80ea-9907e2052fa2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:45.192936 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-f18d6297-6654-485b-80ea-9907e2052fa2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:45.199597 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f18d6297-6654-485b-80ea-9907e2052fa2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:45.200055 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f18d6297-6654-485b-80ea-9907e2052fa2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:45.200943 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f18d6297-6654-485b-80ea-9907e2052fa2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:45.201479 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f18d6297-6654-485b-80ea-9907e2052fa2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:45.303438 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7c3c6b6e-d005-43dc-a910-bb04ec75c68c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:45.303971 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-7c3c6b6e-d005-43dc-a910-bb04ec75c68c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:45.310059 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7c3c6b6e-d005-43dc-a910-bb04ec75c68c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:45.311114 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7c3c6b6e-d005-43dc-a910-bb04ec75c68c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:45.311976 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7c3c6b6e-d005-43dc-a910-bb04ec75c68c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:45.312413 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7c3c6b6e-d005-43dc-a910-bb04ec75c68c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:45.337149 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-f18d6297-6654-485b-80ea-9907e2052fa2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:45.344771 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-f18d6297-6654-485b-80ea-9907e2052fa2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1357 microversion: 2.1 time: 0.156552 May 25 07:45:45.345347 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 495/946] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:45 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1357 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:45.381952 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7c3c6b6e-d005-43dc-a910-bb04ec75c68c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:45.389494 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-7c3c6b6e-d005-43dc-a910-bb04ec75c68c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1192 microversion: 2.1 time: 0.090311 May 25 07:45:45.390058 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 452/947] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:45 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1192 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:45:45.813719 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-c04a0990-bf28-4d7f-a21c-f262b880095b tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:45.814369 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-c04a0990-bf28-4d7f-a21c-f262b880095b tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:45.820337 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c04a0990-bf28-4d7f-a21c-f262b880095b tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:45.820805 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c04a0990-bf28-4d7f-a21c-f262b880095b tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:45.821689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c04a0990-bf28-4d7f-a21c-f262b880095b tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:45.822128 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c04a0990-bf28-4d7f-a21c-f262b880095b tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:45.840219 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:45.885139 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-c04a0990-bf28-4d7f-a21c-f262b880095b tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:45.893094 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-c04a0990-bf28-4d7f-a21c-f262b880095b tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a" status: 200 len: 1271 microversion: 2.1 time: 0.083483 May 25 07:45:45.899225 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 496/948] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:45 2022] GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a => generated 1271 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:46.361501 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1dde3b03-ecae-4b9b-99b3-f2fdcd169e30 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:46.362139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-1dde3b03-ecae-4b9b-99b3-f2fdcd169e30 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:46.369422 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1dde3b03-ecae-4b9b-99b3-f2fdcd169e30 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:46.369422 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1dde3b03-ecae-4b9b-99b3-f2fdcd169e30 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:46.370244 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1dde3b03-ecae-4b9b-99b3-f2fdcd169e30 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:46.370687 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1dde3b03-ecae-4b9b-99b3-f2fdcd169e30 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:46.406679 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-656fe00b-aa8c-4314-831b-97bee1270ed5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:46.407411 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-656fe00b-aa8c-4314-831b-97bee1270ed5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:46.414668 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-656fe00b-aa8c-4314-831b-97bee1270ed5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:46.415254 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-656fe00b-aa8c-4314-831b-97bee1270ed5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:46.416110 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-656fe00b-aa8c-4314-831b-97bee1270ed5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:46.416625 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-656fe00b-aa8c-4314-831b-97bee1270ed5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:46.485153 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-656fe00b-aa8c-4314-831b-97bee1270ed5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:46.503500 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-656fe00b-aa8c-4314-831b-97bee1270ed5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1210 microversion: 2.1 time: 0.091632 May 25 07:45:46.503500 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 497/949] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:46 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1210 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:46.678586 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1dde3b03-ecae-4b9b-99b3-f2fdcd169e30 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:46.682223 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:46.686893 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-1dde3b03-ecae-4b9b-99b3-f2fdcd169e30 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1357 microversion: 2.1 time: 0.330013 May 25 07:45:46.689479 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 453/950] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:46 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1357 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:46.910821 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-920005b8-2bf5-44d0-8ea5-d7622ea0ae5c tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:46.911861 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-920005b8-2bf5-44d0-8ea5-d7622ea0ae5c tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:46.918571 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-920005b8-2bf5-44d0-8ea5-d7622ea0ae5c tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:46.919025 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-920005b8-2bf5-44d0-8ea5-d7622ea0ae5c tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:46.919821 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-920005b8-2bf5-44d0-8ea5-d7622ea0ae5c tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:46.920691 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-920005b8-2bf5-44d0-8ea5-d7622ea0ae5c tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:46.982587 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-920005b8-2bf5-44d0-8ea5-d7622ea0ae5c tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:46.991393 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-920005b8-2bf5-44d0-8ea5-d7622ea0ae5c tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a" status: 200 len: 1277 microversion: 2.1 time: 0.084815 May 25 07:45:46.992357 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 498/951] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:46 2022] GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a => generated 1277 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:47.512522 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-8e9706d6-7846-44d3-b679-6436d3327e7f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:47.514722 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-8e9706d6-7846-44d3-b679-6436d3327e7f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:47.526469 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8e9706d6-7846-44d3-b679-6436d3327e7f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:47.526916 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8e9706d6-7846-44d3-b679-6436d3327e7f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:47.528046 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8e9706d6-7846-44d3-b679-6436d3327e7f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:47.528826 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8e9706d6-7846-44d3-b679-6436d3327e7f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:47.704988 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-6f9d5122-e87b-4bd4-a778-75175f3b8ab5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:47.705889 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-6f9d5122-e87b-4bd4-a778-75175f3b8ab5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:47.713965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6f9d5122-e87b-4bd4-a778-75175f3b8ab5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:47.715698 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6f9d5122-e87b-4bd4-a778-75175f3b8ab5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:47.715698 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6f9d5122-e87b-4bd4-a778-75175f3b8ab5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:47.715698 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6f9d5122-e87b-4bd4-a778-75175f3b8ab5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:47.879236 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-6f9d5122-e87b-4bd4-a778-75175f3b8ab5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:47.887899 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-6f9d5122-e87b-4bd4-a778-75175f3b8ab5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1357 microversion: 2.1 time: 0.188211 May 25 07:45:47.888494 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 499/952] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:47 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1357 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:48.010032 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-448ed9ff-fe60-4da2-8902-84abbfdf8550 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:48.010912 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-448ed9ff-fe60-4da2-8902-84abbfdf8550 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:48.013418 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-8e9706d6-7846-44d3-b679-6436d3327e7f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:48.017561 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-448ed9ff-fe60-4da2-8902-84abbfdf8550 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:48.018088 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-448ed9ff-fe60-4da2-8902-84abbfdf8550 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:48.018944 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-448ed9ff-fe60-4da2-8902-84abbfdf8550 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:48.019445 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-448ed9ff-fe60-4da2-8902-84abbfdf8550 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:48.021949 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-8e9706d6-7846-44d3-b679-6436d3327e7f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1278 microversion: 2.1 time: 0.515002 May 25 07:45:48.022525 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 454/953] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:47 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1278 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:48.151203 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-448ed9ff-fe60-4da2-8902-84abbfdf8550 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:48.159972 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-448ed9ff-fe60-4da2-8902-84abbfdf8550 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a" status: 200 len: 1319 microversion: 2.1 time: 0.153944 May 25 07:45:48.160567 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 500/954] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:48 2022] GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:45:48.905262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-924d585f-3db3-4850-a54f-69a5237f39bd tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:48.906682 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-924d585f-3db3-4850-a54f-69a5237f39bd tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:48.913820 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-924d585f-3db3-4850-a54f-69a5237f39bd tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:48.914538 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-924d585f-3db3-4850-a54f-69a5237f39bd tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:48.915741 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-924d585f-3db3-4850-a54f-69a5237f39bd tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:48.916346 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-924d585f-3db3-4850-a54f-69a5237f39bd tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:49.039624 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-6c2091f0-3aa3-4b38-946a-4f45877642e2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:49.041346 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-6c2091f0-3aa3-4b38-946a-4f45877642e2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:49.044122 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=79,nova_api:INSERT=6 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:49.050067 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6c2091f0-3aa3-4b38-946a-4f45877642e2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:49.050524 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6c2091f0-3aa3-4b38-946a-4f45877642e2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:49.051514 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6c2091f0-3aa3-4b38-946a-4f45877642e2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:49.051959 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6c2091f0-3aa3-4b38-946a-4f45877642e2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:49.195843 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-6c2091f0-3aa3-4b38-946a-4f45877642e2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:49.205248 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-6c2091f0-3aa3-4b38-946a-4f45877642e2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1266 microversion: 2.1 time: 0.169977 May 25 07:45:49.214539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 501/955] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:49 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:45:49.214786 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-924d585f-3db3-4850-a54f-69a5237f39bd tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:49.214928 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-924d0529-8252-450a-975b-272910966470 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:49.214928 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-924d0529-8252-450a-975b-272910966470 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:49.217989 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-924d585f-3db3-4850-a54f-69a5237f39bd tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1357 microversion: 2.1 time: 0.316890 May 25 07:45:49.218444 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-924d0529-8252-450a-975b-272910966470 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:49.218904 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 455/956] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:48 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1357 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:49.219054 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-924d0529-8252-450a-975b-272910966470 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:49.219763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-924d0529-8252-450a-975b-272910966470 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:49.220262 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-924d0529-8252-450a-975b-272910966470 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:49.362662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-924d0529-8252-450a-975b-272910966470 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:49.370289 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-924d0529-8252-450a-975b-272910966470 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a" status: 200 len: 1319 microversion: 2.1 time: 0.163025 May 25 07:45:49.370865 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 502/957] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:49 2022] GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a => generated 1319 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:49.450584 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-9309cd47-9976-407c-b81a-a4567fbccf9d req-0f66654c-8d80-40f6-854c-486c9b5d2114 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "684d03bd-f960-4032-8299-19dc8fa3029e", "tag": "4241ca06-1fe2-4402-b408-b4b6b705733f"}, {"name": "network-changed", "server_uuid": "0904e314-a1e9-453e-9182-e709d655845a", "tag": "5ca72084-eb9a-4af3-b2f5-c7d1050e2584"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:45:49.461354 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-9309cd47-9976-407c-b81a-a4567fbccf9d req-0f66654c-8d80-40f6-854c-486c9b5d2114 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:49.461865 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-9309cd47-9976-407c-b81a-a4567fbccf9d req-0f66654c-8d80-40f6-854c-486c9b5d2114 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:49.475746 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-9309cd47-9976-407c-b81a-a4567fbccf9d req-0f66654c-8d80-40f6-854c-486c9b5d2114 service nova] Creating event network-changed:4241ca06-1fe2-4402-b408-b4b6b705733f for instance 684d03bd-f960-4032-8299-19dc8fa3029e on hv-cinder-82549 May 25 07:45:49.476259 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-9309cd47-9976-407c-b81a-a4567fbccf9d req-0f66654c-8d80-40f6-854c-486c9b5d2114 service nova] Creating event network-changed:5ca72084-eb9a-4af3-b2f5-c7d1050e2584 for instance 0904e314-a1e9-453e-9182-e709d655845a on hv-cinder-82549 May 25 07:45:49.488059 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-9309cd47-9976-407c-b81a-a4567fbccf9d req-0f66654c-8d80-40f6-854c-486c9b5d2114 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.041976 May 25 07:45:49.488922 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 456/958] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:45:49 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:45:50.223243 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-c5296a9e-0c45-40ac-9014-c61984345462 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:50.223897 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-c5296a9e-0c45-40ac-9014-c61984345462 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:50.225886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=2 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:50.231736 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c5296a9e-0c45-40ac-9014-c61984345462 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:50.232214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c5296a9e-0c45-40ac-9014-c61984345462 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:50.233189 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c5296a9e-0c45-40ac-9014-c61984345462 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:50.233726 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c5296a9e-0c45-40ac-9014-c61984345462 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:50.238579 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-f333c986-35ef-4eb4-8ed7-fd0bbf174373 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:50.239857 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-f333c986-35ef-4eb4-8ed7-fd0bbf174373 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:50.247024 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f333c986-35ef-4eb4-8ed7-fd0bbf174373 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:50.247484 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f333c986-35ef-4eb4-8ed7-fd0bbf174373 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:50.248298 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f333c986-35ef-4eb4-8ed7-fd0bbf174373 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:50.248770 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f333c986-35ef-4eb4-8ed7-fd0bbf174373 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:50.372570 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-c5296a9e-0c45-40ac-9014-c61984345462 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:50.380809 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-f333c986-35ef-4eb4-8ed7-fd0bbf174373 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:50.381222 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-c5296a9e-0c45-40ac-9014-c61984345462 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1266 microversion: 2.1 time: 0.161992 May 25 07:45:50.384510 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 503/959] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:50 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:50.387845 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-2930585f-f7b1-40f3-8994-2d04681e987e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:50.388463 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-2930585f-f7b1-40f3-8994-2d04681e987e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:50.388610 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-f333c986-35ef-4eb4-8ed7-fd0bbf174373 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1357 microversion: 2.1 time: 0.156777 May 25 07:45:50.391081 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 457/960] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:50 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:45:50.396012 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2930585f-f7b1-40f3-8994-2d04681e987e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:50.396469 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2930585f-f7b1-40f3-8994-2d04681e987e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:50.397286 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2930585f-f7b1-40f3-8994-2d04681e987e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:50.397722 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2930585f-f7b1-40f3-8994-2d04681e987e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:50.530040 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-2930585f-f7b1-40f3-8994-2d04681e987e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:50.537478 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-2930585f-f7b1-40f3-8994-2d04681e987e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a" status: 200 len: 1319 microversion: 2.1 time: 0.153452 May 25 07:45:50.538044 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 504/961] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:50 2022] GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a => generated 1319 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:50.892279 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-4c2188d2-0b5e-4282-9078-1cb5a79a6584 req-50b8dd5d-d995-4293-aff4-fac88cc957a4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "892bc459-4577-4e8c-b87f-04861e9f1ea8", "name": "network-vif-plugged", "status": "completed", "tag": "eed8a0c9-0f18-40ef-a65e-38b52e79aa6e"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:45:50.900384 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-4c2188d2-0b5e-4282-9078-1cb5a79a6584 req-50b8dd5d-d995-4293-aff4-fac88cc957a4 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:50.900974 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-4c2188d2-0b5e-4282-9078-1cb5a79a6584 req-50b8dd5d-d995-4293-aff4-fac88cc957a4 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:50.914078 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-4c2188d2-0b5e-4282-9078-1cb5a79a6584 req-50b8dd5d-d995-4293-aff4-fac88cc957a4 service nova] Creating event network-vif-plugged:eed8a0c9-0f18-40ef-a65e-38b52e79aa6e for instance 892bc459-4577-4e8c-b87f-04861e9f1ea8 on hv-cinder-82549 May 25 07:45:50.916803 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-4c2188d2-0b5e-4282-9078-1cb5a79a6584 req-50b8dd5d-d995-4293-aff4-fac88cc957a4 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028197 May 25 07:45:50.917385 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 458/962] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:45:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:45:51.403480 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-f325c50d-e0b7-4595-87e7-c737fef9f068 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:51.405283 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-f325c50d-e0b7-4595-87e7-c737fef9f068 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:51.413125 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f325c50d-e0b7-4595-87e7-c737fef9f068 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:51.414489 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f325c50d-e0b7-4595-87e7-c737fef9f068 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:51.415111 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f325c50d-e0b7-4595-87e7-c737fef9f068 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:51.415746 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f325c50d-e0b7-4595-87e7-c737fef9f068 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:51.415934 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-cc0d8473-596d-4956-bc9e-5a4c98653b9c tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:51.417816 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-cc0d8473-596d-4956-bc9e-5a4c98653b9c tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:51.427012 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:51.433704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cc0d8473-596d-4956-bc9e-5a4c98653b9c tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:51.434440 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cc0d8473-596d-4956-bc9e-5a4c98653b9c tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:51.435402 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cc0d8473-596d-4956-bc9e-5a4c98653b9c tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:51.436220 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-cc0d8473-596d-4956-bc9e-5a4c98653b9c tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:51.527406 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=2 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:51.547503 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=8 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:51.646988 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-cc0d8473-596d-4956-bc9e-5a4c98653b9c tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:51.651603 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-f325c50d-e0b7-4595-87e7-c737fef9f068 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:51.663398 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-cc0d8473-596d-4956-bc9e-5a4c98653b9c tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1357 microversion: 2.1 time: 0.259609 May 25 07:45:51.664275 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 459/963] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:51 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1357 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:51.665724 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-f325c50d-e0b7-4595-87e7-c737fef9f068 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1266 microversion: 2.1 time: 0.266386 May 25 07:45:51.666317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 505/964] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:51 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1266 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:51.670086 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d7ff2a59-a4c5-4c9d-8946-1556e8be7419 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:51.671004 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d7ff2a59-a4c5-4c9d-8946-1556e8be7419 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:51.681412 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d7ff2a59-a4c5-4c9d-8946-1556e8be7419 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:51.681864 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d7ff2a59-a4c5-4c9d-8946-1556e8be7419 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:51.682790 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d7ff2a59-a4c5-4c9d-8946-1556e8be7419 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:51.683544 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d7ff2a59-a4c5-4c9d-8946-1556e8be7419 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:51.822421 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d7ff2a59-a4c5-4c9d-8946-1556e8be7419 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:51.832394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d7ff2a59-a4c5-4c9d-8946-1556e8be7419 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a" status: 200 len: 1319 microversion: 2.1 time: 0.166799 May 25 07:45:51.839523 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 460/965] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:51 2022] GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:52.682648 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c8f41e5f-8a3e-4691-b3a4-4bd189982188 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:52.686844 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-eebcb49a-f6df-42ba-b8f3-b3d215b30650 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:52.687512 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-eebcb49a-f6df-42ba-b8f3-b3d215b30650 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:52.688410 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c8f41e5f-8a3e-4691-b3a4-4bd189982188 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:52.694807 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=8 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:52.698853 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eebcb49a-f6df-42ba-b8f3-b3d215b30650 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:52.699312 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eebcb49a-f6df-42ba-b8f3-b3d215b30650 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:52.700101 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eebcb49a-f6df-42ba-b8f3-b3d215b30650 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:52.700567 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-eebcb49a-f6df-42ba-b8f3-b3d215b30650 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:52.707935 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c8f41e5f-8a3e-4691-b3a4-4bd189982188 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:52.708394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c8f41e5f-8a3e-4691-b3a4-4bd189982188 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:52.709220 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c8f41e5f-8a3e-4691-b3a4-4bd189982188 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:52.709663 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c8f41e5f-8a3e-4691-b3a4-4bd189982188 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:52.859522 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-eebcb49a-f6df-42ba-b8f3-b3d215b30650 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:52.870296 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c8f41e5f-8a3e-4691-b3a4-4bd189982188 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:52.891583 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-eebcb49a-f6df-42ba-b8f3-b3d215b30650 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1357 microversion: 2.1 time: 0.190637 May 25 07:45:52.901040 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 506/966] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:52 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1357 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:52.902859 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c8f41e5f-8a3e-4691-b3a4-4bd189982188 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1266 microversion: 2.1 time: 0.223990 May 25 07:45:52.903445 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 461/967] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:52 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1266 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:52.905625 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-c95a11c4-6b8b-4573-91bd-4ed25083e1f4 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:52.906314 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-c95a11c4-6b8b-4573-91bd-4ed25083e1f4 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:52.913431 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c95a11c4-6b8b-4573-91bd-4ed25083e1f4 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:52.913624 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c95a11c4-6b8b-4573-91bd-4ed25083e1f4 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:52.914314 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c95a11c4-6b8b-4573-91bd-4ed25083e1f4 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:52.915131 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-c95a11c4-6b8b-4573-91bd-4ed25083e1f4 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:53.053301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-c95a11c4-6b8b-4573-91bd-4ed25083e1f4 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:53.061618 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-c95a11c4-6b8b-4573-91bd-4ed25083e1f4 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a" status: 200 len: 1319 microversion: 2.1 time: 0.163271 May 25 07:45:53.062761 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 507/968] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:52 2022] GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a => generated 1319 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:53.909224 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-517ee206-8cbf-41df-bd88-dc6435c3e259 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:53.909941 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-517ee206-8cbf-41df-bd88-dc6435c3e259 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:53.916646 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-517ee206-8cbf-41df-bd88-dc6435c3e259 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:53.917101 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-517ee206-8cbf-41df-bd88-dc6435c3e259 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:53.917864 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-517ee206-8cbf-41df-bd88-dc6435c3e259 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:53.918329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-517ee206-8cbf-41df-bd88-dc6435c3e259 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:53.925457 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ee189557-db39-4d4d-b547-c7a4cbb92867 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:53.926074 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ee189557-db39-4d4d-b547-c7a4cbb92867 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:53.932635 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ee189557-db39-4d4d-b547-c7a4cbb92867 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:53.933088 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ee189557-db39-4d4d-b547-c7a4cbb92867 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:53.933851 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ee189557-db39-4d4d-b547-c7a4cbb92867 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:53.934441 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ee189557-db39-4d4d-b547-c7a4cbb92867 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:54.080248 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ee189557-db39-4d4d-b547-c7a4cbb92867 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:54.088728 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ee189557-db39-4d4d-b547-c7a4cbb92867 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1266 microversion: 2.1 time: 0.167236 May 25 07:45:54.089467 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 508/969] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:53 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:45:54.094969 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-03a2fe7e-41c3-42cf-966b-dad89646a8e2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:54.095879 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-03a2fe7e-41c3-42cf-966b-dad89646a8e2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:54.101135 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-517ee206-8cbf-41df-bd88-dc6435c3e259 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:54.109656 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-517ee206-8cbf-41df-bd88-dc6435c3e259 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1546 microversion: 2.1 time: 0.205133 May 25 07:45:54.110235 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 462/970] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:53 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1546 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:54.115053 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-03a2fe7e-41c3-42cf-966b-dad89646a8e2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:54.115509 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-03a2fe7e-41c3-42cf-966b-dad89646a8e2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:54.116289 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-03a2fe7e-41c3-42cf-966b-dad89646a8e2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:54.117201 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-03a2fe7e-41c3-42cf-966b-dad89646a8e2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:54.126543 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-452305c4-0283-4964-902a-b20320fff774 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:54.127186 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-452305c4-0283-4964-902a-b20320fff774 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:54.133646 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-452305c4-0283-4964-902a-b20320fff774 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:54.134364 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-452305c4-0283-4964-902a-b20320fff774 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:54.135151 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-452305c4-0283-4964-902a-b20320fff774 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:54.135583 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-452305c4-0283-4964-902a-b20320fff774 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:54.271409 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-452305c4-0283-4964-902a-b20320fff774 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:54.274303 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-03a2fe7e-41c3-42cf-966b-dad89646a8e2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:54.279105 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-452305c4-0283-4964-902a-b20320fff774 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1546 microversion: 2.1 time: 0.156837 May 25 07:45:54.280915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 463/971] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:54 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1546 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:54.282375 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-03a2fe7e-41c3-42cf-966b-dad89646a8e2 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a" status: 200 len: 1319 microversion: 2.1 time: 0.191739 May 25 07:45:54.282946 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 509/972] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:54 2022] GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a => generated 1319 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:54.295985 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c33a14fa-7d68-4d60-b629-bffbd9ba9703 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:54.299478 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c33a14fa-7d68-4d60-b629-bffbd9ba9703 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:54.300251 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c33a14fa-7d68-4d60-b629-bffbd9ba9703 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Searching by: {'deleted': False, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f'} {{(pid=124674) get_all /opt/stack/nova/nova/compute/api.py:2962}} May 25 07:45:54.306974 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c33a14fa-7d68-4d60-b629-bffbd9ba9703 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:54.307428 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c33a14fa-7d68-4d60-b629-bffbd9ba9703 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:54.308226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c33a14fa-7d68-4d60-b629-bffbd9ba9703 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:54.308699 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c33a14fa-7d68-4d60-b629-bffbd9ba9703 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:54.406766 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.multi_cell_list [None req-c33a14fa-7d68-4d60-b629-bffbd9ba9703 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=124674) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} May 25 07:45:54.501728 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c33a14fa-7d68-4d60-b629-bffbd9ba9703 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.209830 May 25 07:45:54.502323 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 464/973] 10.222.0.24 () {58 vars in 1124 bytes} [Wed May 25 07:45:54 2022] GET /compute/v2.1/servers => generated 343 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:45:54.512684 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a1bb54d7-e59c-428a-8cb8-4b4bb77842f6 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:54.513301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a1bb54d7-e59c-428a-8cb8-4b4bb77842f6 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:54.520068 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a1bb54d7-e59c-428a-8cb8-4b4bb77842f6 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:54.520550 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a1bb54d7-e59c-428a-8cb8-4b4bb77842f6 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:54.521317 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a1bb54d7-e59c-428a-8cb8-4b4bb77842f6 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:54.521757 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a1bb54d7-e59c-428a-8cb8-4b4bb77842f6 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:54.662536 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a1bb54d7-e59c-428a-8cb8-4b4bb77842f6 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:54.670933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a1bb54d7-e59c-428a-8cb8-4b4bb77842f6 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1546 microversion: 2.1 time: 0.161901 May 25 07:45:54.671606 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 510/974] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:54 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1546 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:54.905363 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-286d779c-d2e9-4017-921b-701b975b8de1 req-df68b9b8-6827-4f16-b397-5d40c403b029 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0904e314-a1e9-453e-9182-e709d655845a", "name": "network-vif-plugged", "status": "completed", "tag": "5ca72084-eb9a-4af3-b2f5-c7d1050e2584"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:45:54.914118 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-286d779c-d2e9-4017-921b-701b975b8de1 req-df68b9b8-6827-4f16-b397-5d40c403b029 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:54.914736 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-286d779c-d2e9-4017-921b-701b975b8de1 req-df68b9b8-6827-4f16-b397-5d40c403b029 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:54.926329 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-286d779c-d2e9-4017-921b-701b975b8de1 req-df68b9b8-6827-4f16-b397-5d40c403b029 service nova] Creating event network-vif-plugged:5ca72084-eb9a-4af3-b2f5-c7d1050e2584 for instance 0904e314-a1e9-453e-9182-e709d655845a on hv-cinder-82549 May 25 07:45:54.931240 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-286d779c-d2e9-4017-921b-701b975b8de1 req-df68b9b8-6827-4f16-b397-5d40c403b029 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029820 May 25 07:45:54.931815 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 465/975] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:45:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:45:55.106708 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-0f7342e4-c52b-4dff-b2d7-45aee335f454 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:55.107965 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-0f7342e4-c52b-4dff-b2d7-45aee335f454 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:55.115326 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0f7342e4-c52b-4dff-b2d7-45aee335f454 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:55.115806 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0f7342e4-c52b-4dff-b2d7-45aee335f454 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:55.116884 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0f7342e4-c52b-4dff-b2d7-45aee335f454 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:55.117328 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0f7342e4-c52b-4dff-b2d7-45aee335f454 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:55.256924 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-0f7342e4-c52b-4dff-b2d7-45aee335f454 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:55.265329 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-0f7342e4-c52b-4dff-b2d7-45aee335f454 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1266 microversion: 2.1 time: 0.162422 May 25 07:45:55.265922 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 511/976] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:55 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:55.305626 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-4b38aa86-2250-4939-8ca8-6e45e91621b8 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:55.305626 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-4b38aa86-2250-4939-8ca8-6e45e91621b8 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:55.311213 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4b38aa86-2250-4939-8ca8-6e45e91621b8 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:55.311665 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4b38aa86-2250-4939-8ca8-6e45e91621b8 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:55.312452 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4b38aa86-2250-4939-8ca8-6e45e91621b8 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:55.312917 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4b38aa86-2250-4939-8ca8-6e45e91621b8 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:55.446986 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-4b38aa86-2250-4939-8ca8-6e45e91621b8 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:55.454571 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-4b38aa86-2250-4939-8ca8-6e45e91621b8 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a" status: 200 len: 1319 microversion: 2.1 time: 0.154627 May 25 07:45:55.455255 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 466/977] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:55 2022] GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:56.282678 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4354b520-05b7-4036-9b42-726644b9d592 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:56.283215 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4354b520-05b7-4036-9b42-726644b9d592 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:56.289680 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4354b520-05b7-4036-9b42-726644b9d592 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:56.290162 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4354b520-05b7-4036-9b42-726644b9d592 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:56.290926 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4354b520-05b7-4036-9b42-726644b9d592 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:56.291362 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4354b520-05b7-4036-9b42-726644b9d592 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:56.429132 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-4354b520-05b7-4036-9b42-726644b9d592 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:56.436762 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4354b520-05b7-4036-9b42-726644b9d592 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1266 microversion: 2.1 time: 0.158615 May 25 07:45:56.437697 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 512/978] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:56 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:56.471860 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-25202473-8ccc-441d-86a8-464d5d02555e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:56.472645 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-25202473-8ccc-441d-86a8-464d5d02555e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:56.479734 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-25202473-8ccc-441d-86a8-464d5d02555e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:56.480181 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-25202473-8ccc-441d-86a8-464d5d02555e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:56.481609 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-25202473-8ccc-441d-86a8-464d5d02555e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:56.482050 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-25202473-8ccc-441d-86a8-464d5d02555e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:56.582614 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-93c9cfd2-377f-4460-a87d-2647bb4b9582 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "25f1080c-a4f2-4a5b-bf52-058e0e512e1f"}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:45:56.584632 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-93c9cfd2-377f-4460-a87d-2647bb4b9582 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:56.590275 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-93c9cfd2-377f-4460-a87d-2647bb4b9582 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:56.590734 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-93c9cfd2-377f-4460-a87d-2647bb4b9582 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:56.591523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-93c9cfd2-377f-4460-a87d-2647bb4b9582 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:56.592689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-93c9cfd2-377f-4460-a87d-2647bb4b9582 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:56.597034 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=100 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:45:56.617163 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-25202473-8ccc-441d-86a8-464d5d02555e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:56.625087 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-25202473-8ccc-441d-86a8-464d5d02555e tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a" status: 200 len: 1507 microversion: 2.1 time: 0.157907 May 25 07:45:56.625662 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 467/979] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:56 2022] GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a => generated 1507 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:56.642030 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d5019fbf-1672-4eb0-9d0f-391865a5bd56 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "f97f181e-dac8-466d-88a5-95d540640773", "device": "/dev/sdb"}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:45:56.643620 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d5019fbf-1672-4eb0-9d0f-391865a5bd56 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:56.649581 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d5019fbf-1672-4eb0-9d0f-391865a5bd56 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:56.650029 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d5019fbf-1672-4eb0-9d0f-391865a5bd56 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:56.650789 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d5019fbf-1672-4eb0-9d0f-391865a5bd56 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:56.651224 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d5019fbf-1672-4eb0-9d0f-391865a5bd56 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:57.444719 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-93c9cfd2-377f-4460-a87d-2647bb4b9582 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "POST /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.865986 May 25 07:45:57.445346 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 513/980] 10.222.0.24 () {60 vars in 1322 bytes} [Wed May 25 07:45:56 2022] POST /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8/os-volume_attachments => generated 194 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:45:57.453867 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b16e41ab-e3e9-4d46-9b95-4b3fe8832321 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:57.454641 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b16e41ab-e3e9-4d46-9b95-4b3fe8832321 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:57.467407 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d5019fbf-1672-4eb0-9d0f-391865a5bd56 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "POST /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.829689 May 25 07:45:57.469300 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 468/981] 10.222.0.24 () {60 vars in 1322 bytes} [Wed May 25 07:45:56 2022] POST /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a/os-volume_attachments => generated 194 bytes in 831 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:45:57.469451 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b16e41ab-e3e9-4d46-9b95-4b3fe8832321 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:57.469451 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b16e41ab-e3e9-4d46-9b95-4b3fe8832321 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:57.469680 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b16e41ab-e3e9-4d46-9b95-4b3fe8832321 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:57.470622 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b16e41ab-e3e9-4d46-9b95-4b3fe8832321 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:57.609643 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b16e41ab-e3e9-4d46-9b95-4b3fe8832321 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:57.618513 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b16e41ab-e3e9-4d46-9b95-4b3fe8832321 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1266 microversion: 2.1 time: 0.168761 May 25 07:45:57.619078 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 514/982] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:57 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:45:58.636750 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-0c3b7496-32e2-487c-8919-e192513fe133 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:58.637453 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-0c3b7496-32e2-487c-8919-e192513fe133 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:58.643702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0c3b7496-32e2-487c-8919-e192513fe133 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:58.644150 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0c3b7496-32e2-487c-8919-e192513fe133 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:58.644955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0c3b7496-32e2-487c-8919-e192513fe133 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:58.645401 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-0c3b7496-32e2-487c-8919-e192513fe133 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:58.778528 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-0c3b7496-32e2-487c-8919-e192513fe133 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:58.787251 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-0c3b7496-32e2-487c-8919-e192513fe133 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1266 microversion: 2.1 time: 0.155274 May 25 07:45:58.787847 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 469/983] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:58 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:45:59.804719 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-fa24e6aa-6c88-4d42-80d1-6062ce737e11 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:45:59.805340 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-fa24e6aa-6c88-4d42-80d1-6062ce737e11 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:45:59.811879 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fa24e6aa-6c88-4d42-80d1-6062ce737e11 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:59.812333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fa24e6aa-6c88-4d42-80d1-6062ce737e11 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:59.813140 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fa24e6aa-6c88-4d42-80d1-6062ce737e11 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:45:59.813582 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fa24e6aa-6c88-4d42-80d1-6062ce737e11 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:45:59.941756 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-fa24e6aa-6c88-4d42-80d1-6062ce737e11 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:45:59.949193 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-fa24e6aa-6c88-4d42-80d1-6062ce737e11 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1266 microversion: 2.1 time: 0.148438 May 25 07:45:59.949763 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 515/984] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:45:59 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:46:00.966284 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1dead1bb-71d4-4e6e-8886-0f0dcedb078a tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:00.966915 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-1dead1bb-71d4-4e6e-8886-0f0dcedb078a tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:00.974586 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1dead1bb-71d4-4e6e-8886-0f0dcedb078a tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:00.975042 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1dead1bb-71d4-4e6e-8886-0f0dcedb078a tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:00.975812 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1dead1bb-71d4-4e6e-8886-0f0dcedb078a tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:00.976246 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1dead1bb-71d4-4e6e-8886-0f0dcedb078a tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:01.112002 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1dead1bb-71d4-4e6e-8886-0f0dcedb078a tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:01.112002 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:46:01.114954 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-1dead1bb-71d4-4e6e-8886-0f0dcedb078a tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1266 microversion: 2.1 time: 0.152558 May 25 07:46:01.115471 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 470/985] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:00 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:02.131796 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-50fc4916-3398-49dc-9e4a-de97115f0757 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:02.132460 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-50fc4916-3398-49dc-9e4a-de97115f0757 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:02.138892 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-50fc4916-3398-49dc-9e4a-de97115f0757 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:02.139343 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-50fc4916-3398-49dc-9e4a-de97115f0757 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:02.140104 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-50fc4916-3398-49dc-9e4a-de97115f0757 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:02.140565 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-50fc4916-3398-49dc-9e4a-de97115f0757 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:02.272458 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-50fc4916-3398-49dc-9e4a-de97115f0757 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:02.280005 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-50fc4916-3398-49dc-9e4a-de97115f0757 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1266 microversion: 2.1 time: 0.152261 May 25 07:46:02.280653 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 516/986] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:02 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:02.986200 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-d6771b6b-f444-477b-b9e0-bd49fb396dbc req-83626970-126d-4c87-ab36-36add4d22b0d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "684d03bd-f960-4032-8299-19dc8fa3029e", "name": "network-vif-plugged", "status": "completed", "tag": "4241ca06-1fe2-4402-b408-b4b6b705733f"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:46:02.997025 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-d6771b6b-f444-477b-b9e0-bd49fb396dbc req-83626970-126d-4c87-ab36-36add4d22b0d service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:02.997512 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-d6771b6b-f444-477b-b9e0-bd49fb396dbc req-83626970-126d-4c87-ab36-36add4d22b0d service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:03.008894 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-d6771b6b-f444-477b-b9e0-bd49fb396dbc req-83626970-126d-4c87-ab36-36add4d22b0d service nova] Creating event network-vif-plugged:4241ca06-1fe2-4402-b408-b4b6b705733f for instance 684d03bd-f960-4032-8299-19dc8fa3029e on hv-cinder-82549 May 25 07:46:03.013875 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-d6771b6b-f444-477b-b9e0-bd49fb396dbc req-83626970-126d-4c87-ab36-36add4d22b0d service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031432 May 25 07:46:03.014466 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 471/987] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:46:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:46:03.296931 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-9785e854-9332-422d-ae57-5fa1d76fa325 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:03.297560 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-9785e854-9332-422d-ae57-5fa1d76fa325 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:03.304616 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9785e854-9332-422d-ae57-5fa1d76fa325 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:03.305081 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9785e854-9332-422d-ae57-5fa1d76fa325 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:03.305870 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9785e854-9332-422d-ae57-5fa1d76fa325 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:03.306405 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9785e854-9332-422d-ae57-5fa1d76fa325 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:03.440767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-9785e854-9332-422d-ae57-5fa1d76fa325 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:03.448432 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-9785e854-9332-422d-ae57-5fa1d76fa325 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1266 microversion: 2.1 time: 0.155488 May 25 07:46:03.449043 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 517/988] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:03 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:04.463513 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=2 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:46:04.467944 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-6cd9d190-4c22-441d-9973-deeb2ee4ec49 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:04.468673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-6cd9d190-4c22-441d-9973-deeb2ee4ec49 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:04.475737 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6cd9d190-4c22-441d-9973-deeb2ee4ec49 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:04.476190 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6cd9d190-4c22-441d-9973-deeb2ee4ec49 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:04.476989 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6cd9d190-4c22-441d-9973-deeb2ee4ec49 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:04.477433 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6cd9d190-4c22-441d-9973-deeb2ee4ec49 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:04.614029 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-6cd9d190-4c22-441d-9973-deeb2ee4ec49 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:04.621882 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-6cd9d190-4c22-441d-9973-deeb2ee4ec49 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1266 microversion: 2.1 time: 0.159790 May 25 07:46:04.622455 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 472/989] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:04 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1266 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:05.637781 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ab5e6586-d776-4896-a65e-af984296c633 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:05.638401 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-ab5e6586-d776-4896-a65e-af984296c633 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:05.645630 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ab5e6586-d776-4896-a65e-af984296c633 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:05.646086 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ab5e6586-d776-4896-a65e-af984296c633 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:05.646861 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ab5e6586-d776-4896-a65e-af984296c633 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:05.647304 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-ab5e6586-d776-4896-a65e-af984296c633 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:05.776089 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-ab5e6586-d776-4896-a65e-af984296c633 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:05.784105 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ab5e6586-d776-4896-a65e-af984296c633 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1453 microversion: 2.1 time: 0.150125 May 25 07:46:05.784869 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 518/990] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:05 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1453 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:05.800719 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d43262a8-0cf5-4551-a276-1c19be531f88 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:05.801344 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d43262a8-0cf5-4551-a276-1c19be531f88 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:05.807876 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d43262a8-0cf5-4551-a276-1c19be531f88 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:05.808326 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d43262a8-0cf5-4551-a276-1c19be531f88 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:05.809135 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d43262a8-0cf5-4551-a276-1c19be531f88 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:05.809642 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d43262a8-0cf5-4551-a276-1c19be531f88 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:05.949431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-d43262a8-0cf5-4551-a276-1c19be531f88 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:05.961351 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d43262a8-0cf5-4551-a276-1c19be531f88 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1453 microversion: 2.1 time: 0.164760 May 25 07:46:05.961931 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 473/991] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:05 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1453 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:06.102883 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-909d24d8-8fe3-483d-9340-56b1004fcdbf tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:06.103509 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-909d24d8-8fe3-483d-9340-56b1004fcdbf tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:06.109431 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-909d24d8-8fe3-483d-9340-56b1004fcdbf tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:06.109889 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-909d24d8-8fe3-483d-9340-56b1004fcdbf tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:06.110660 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-909d24d8-8fe3-483d-9340-56b1004fcdbf tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:06.111102 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-909d24d8-8fe3-483d-9340-56b1004fcdbf tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:06.277678 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-909d24d8-8fe3-483d-9340-56b1004fcdbf tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:06.286599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-909d24d8-8fe3-483d-9340-56b1004fcdbf tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1592 microversion: 2.1 time: 0.187700 May 25 07:46:06.287173 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 519/992] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:06 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1592 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:08.201705 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-dd121bf9-8aaa-41e8-8755-f043e4cc9876 req-18a14a85-2ddc-40be-8616-eb33f8de1670 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "684d03bd-f960-4032-8299-19dc8fa3029e", "tag": "4241ca06-1fe2-4402-b408-b4b6b705733f"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:46:08.211865 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-dd121bf9-8aaa-41e8-8755-f043e4cc9876 req-18a14a85-2ddc-40be-8616-eb33f8de1670 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:08.212802 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-dd121bf9-8aaa-41e8-8755-f043e4cc9876 req-18a14a85-2ddc-40be-8616-eb33f8de1670 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:08.225623 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-dd121bf9-8aaa-41e8-8755-f043e4cc9876 req-18a14a85-2ddc-40be-8616-eb33f8de1670 service nova] Creating event network-changed:4241ca06-1fe2-4402-b408-b4b6b705733f for instance 684d03bd-f960-4032-8299-19dc8fa3029e on hv-cinder-82549 May 25 07:46:08.231200 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-dd121bf9-8aaa-41e8-8755-f043e4cc9876 req-18a14a85-2ddc-40be-8616-eb33f8de1670 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036093 May 25 07:46:08.232313 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 474/993] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:46:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:46:09.112539 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-16475aa1-56e4-4d14-abd3-420d77912ea0 req-496a36e5-0cfc-4824-87c8-d232495a9db6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "892bc459-4577-4e8c-b87f-04861e9f1ea8", "tag": "eed8a0c9-0f18-40ef-a65e-38b52e79aa6e"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:46:09.134536 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-16475aa1-56e4-4d14-abd3-420d77912ea0 req-496a36e5-0cfc-4824-87c8-d232495a9db6 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:09.136170 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-16475aa1-56e4-4d14-abd3-420d77912ea0 req-496a36e5-0cfc-4824-87c8-d232495a9db6 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:09.168787 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-16475aa1-56e4-4d14-abd3-420d77912ea0 req-496a36e5-0cfc-4824-87c8-d232495a9db6 service nova] Creating event network-changed:eed8a0c9-0f18-40ef-a65e-38b52e79aa6e for instance 892bc459-4577-4e8c-b87f-04861e9f1ea8 on hv-cinder-82549 May 25 07:46:09.179312 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-16475aa1-56e4-4d14-abd3-420d77912ea0 req-496a36e5-0cfc-4824-87c8-d232495a9db6 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.077295 May 25 07:46:09.194154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 520/994] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:46:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:46:12.045239 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7b21d86e-52a2-4747-ac32-cecaed60f983 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1229247706"}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:46:12.047354 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-7b21d86e-52a2-4747-ac32-cecaed60f983 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:12.053612 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7b21d86e-52a2-4747-ac32-cecaed60f983 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:12.054067 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7b21d86e-52a2-4747-ac32-cecaed60f983 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:12.054851 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7b21d86e-52a2-4747-ac32-cecaed60f983 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:12.055286 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7b21d86e-52a2-4747-ac32-cecaed60f983 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:12.188506 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.network.security_group_api [None req-7b21d86e-52a2-4747-ac32-cecaed60f983 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Adding security group 2eda9b78-83a3-474a-99fa-0c7398f998bc to port eed8a0c9-0f18-40ef-a65e-38b52e79aa6e May 25 07:46:12.629959 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-7b21d86e-52a2-4747-ac32-cecaed60f983 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "POST /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8/action" status: 202 len: 0 microversion: 2.1 time: 0.588238 May 25 07:46:12.630095 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 475/995] 10.222.0.24 () {60 vars in 1277 bytes} [Wed May 25 07:46:12 2022] POST /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8/action => generated 0 bytes in 590 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:46:12.639997 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-0a5855b9-f07c-4a35-9a6d-660aaa0bb43f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:12.645038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-0a5855b9-f07c-4a35-9a6d-660aaa0bb43f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:12.645203 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-bb326039-8223-405d-8ea2-6e2e53749bf4 req-5d679fe6-fc04-40e9-844f-157dc89b97c2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "892bc459-4577-4e8c-b87f-04861e9f1ea8", "tag": "eed8a0c9-0f18-40ef-a65e-38b52e79aa6e"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:46:12.648499 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0a5855b9-f07c-4a35-9a6d-660aaa0bb43f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:12.649190 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0a5855b9-f07c-4a35-9a6d-660aaa0bb43f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:12.650157 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0a5855b9-f07c-4a35-9a6d-660aaa0bb43f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:12.650765 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0a5855b9-f07c-4a35-9a6d-660aaa0bb43f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:12.657547 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-bb326039-8223-405d-8ea2-6e2e53749bf4 req-5d679fe6-fc04-40e9-844f-157dc89b97c2 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:12.658367 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-bb326039-8223-405d-8ea2-6e2e53749bf4 req-5d679fe6-fc04-40e9-844f-157dc89b97c2 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:12.686210 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-bb326039-8223-405d-8ea2-6e2e53749bf4 req-5d679fe6-fc04-40e9-844f-157dc89b97c2 service nova] Creating event network-changed:eed8a0c9-0f18-40ef-a65e-38b52e79aa6e for instance 892bc459-4577-4e8c-b87f-04861e9f1ea8 on hv-cinder-82549 May 25 07:46:12.696150 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-bb326039-8223-405d-8ea2-6e2e53749bf4 req-5d679fe6-fc04-40e9-844f-157dc89b97c2 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058292 May 25 07:46:12.700356 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 476/996] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:46:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:46:12.858594 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-0a5855b9-f07c-4a35-9a6d-660aaa0bb43f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:12.868762 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-0a5855b9-f07c-4a35-9a6d-660aaa0bb43f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1757 microversion: 2.1 time: 0.233715 May 25 07:46:12.869476 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 521/997] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:12 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1757 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:25.925462 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=34 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:46:25.926327 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=22 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:46:25.930530 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-51893507-5b75-489f-b544-5ecf0a4f8e51 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:25.931104 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-51893507-5b75-489f-b544-5ecf0a4f8e51 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:25.937225 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-51893507-5b75-489f-b544-5ecf0a4f8e51 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:25.939740 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-51893507-5b75-489f-b544-5ecf0a4f8e51 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:25.939740 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-51893507-5b75-489f-b544-5ecf0a4f8e51 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:25.939740 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-51893507-5b75-489f-b544-5ecf0a4f8e51 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:26.022817 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.objects.instance [None req-51893507-5b75-489f-b544-5ecf0a4f8e51 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lazy-loading 'services' on Instance uuid 0904e314-a1e9-453e-9182-e709d655845a {{(pid=124674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:46:26.257557 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-51893507-5b75-489f-b544-5ecf0a4f8e51 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "DELETE /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a/os-volume_attachments/f97f181e-dac8-466d-88a5-95d540640773" status: 202 len: 0 microversion: 2.1 time: 0.333266 May 25 07:46:26.258145 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 477/998] 10.222.0.24 () {58 vars in 1415 bytes} [Wed May 25 07:46:25 2022] DELETE /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a/os-volume_attachments/f97f181e-dac8-466d-88a5-95d540640773 => generated 0 bytes in 335 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:46:27.370103 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-f76908b7-9dde-4d3e-acce-33aa4a76e68a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:27.370627 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-f76908b7-9dde-4d3e-acce-33aa4a76e68a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:27.373173 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=41 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:46:27.373857 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=53,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:46:27.378622 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f76908b7-9dde-4d3e-acce-33aa4a76e68a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:27.379082 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f76908b7-9dde-4d3e-acce-33aa4a76e68a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:27.379920 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f76908b7-9dde-4d3e-acce-33aa4a76e68a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:27.380371 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-f76908b7-9dde-4d3e-acce-33aa4a76e68a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:27.407168 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-f76908b7-9dde-4d3e-acce-33aa4a76e68a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Going to try to terminate instance {{(pid=124675) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:46:27.646029 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-f76908b7-9dde-4d3e-acce-33aa4a76e68a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "DELETE /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a" status: 204 len: 0 microversion: 2.1 time: 0.280775 May 25 07:46:27.646757 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 522/999] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:46:27 2022] DELETE /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a => generated 0 bytes in 282 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 07:46:27.655936 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-9813aacd-2b7c-4f2f-b7a0-e54421f24726 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:27.656657 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-9813aacd-2b7c-4f2f-b7a0-e54421f24726 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:27.664212 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9813aacd-2b7c-4f2f-b7a0-e54421f24726 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:27.664885 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9813aacd-2b7c-4f2f-b7a0-e54421f24726 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:27.665655 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9813aacd-2b7c-4f2f-b7a0-e54421f24726 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:27.666143 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9813aacd-2b7c-4f2f-b7a0-e54421f24726 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:27.797249 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9813aacd-2b7c-4f2f-b7a0-e54421f24726 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:27.805266 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-9813aacd-2b7c-4f2f-b7a0-e54421f24726 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a" status: 200 len: 1513 microversion: 2.1 time: 0.154096 May 25 07:46:27.805838 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 478/1000] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:27 2022] GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a => generated 1513 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:28.823359 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-fcc823a8-339c-44a9-9352-c9f2c462d774 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:28.824059 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-fcc823a8-339c-44a9-9352-c9f2c462d774 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:28.830488 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fcc823a8-339c-44a9-9352-c9f2c462d774 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:28.830940 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fcc823a8-339c-44a9-9352-c9f2c462d774 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:28.831694 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fcc823a8-339c-44a9-9352-c9f2c462d774 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:28.832131 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-fcc823a8-339c-44a9-9352-c9f2c462d774 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:28.969395 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-fcc823a8-339c-44a9-9352-c9f2c462d774 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:28.977521 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-fcc823a8-339c-44a9-9352-c9f2c462d774 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a" status: 200 len: 1513 microversion: 2.1 time: 0.158484 May 25 07:46:28.978126 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 523/1001] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:28 2022] GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a => generated 1513 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:46:29.995355 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c3296382-a102-4370-8001-c1674e97e277 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:29.995979 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c3296382-a102-4370-8001-c1674e97e277 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:30.002856 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c3296382-a102-4370-8001-c1674e97e277 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:30.003307 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c3296382-a102-4370-8001-c1674e97e277 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:30.004088 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c3296382-a102-4370-8001-c1674e97e277 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:30.004554 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c3296382-a102-4370-8001-c1674e97e277 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:30.338371 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c3296382-a102-4370-8001-c1674e97e277 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:30.345862 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c3296382-a102-4370-8001-c1674e97e277 tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a" status: 200 len: 1513 microversion: 2.1 time: 0.354705 May 25 07:46:30.346439 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 479/1002] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:29 2022] GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a => generated 1513 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:30.484349 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-906417b2-1b36-4eb2-b5ad-d77cc6dbca0b req-b9a52a9f-452b-4f2e-9049-23d9b8bd0435 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0904e314-a1e9-453e-9182-e709d655845a", "name": "network-vif-deleted", "tag": "5ca72084-eb9a-4af3-b2f5-c7d1050e2584"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:46:30.493146 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-906417b2-1b36-4eb2-b5ad-d77cc6dbca0b req-b9a52a9f-452b-4f2e-9049-23d9b8bd0435 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:30.493597 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-906417b2-1b36-4eb2-b5ad-d77cc6dbca0b req-b9a52a9f-452b-4f2e-9049-23d9b8bd0435 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:30.504428 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-906417b2-1b36-4eb2-b5ad-d77cc6dbca0b req-b9a52a9f-452b-4f2e-9049-23d9b8bd0435 service nova] Creating event network-vif-deleted:5ca72084-eb9a-4af3-b2f5-c7d1050e2584 for instance 0904e314-a1e9-453e-9182-e709d655845a on hv-cinder-82549 May 25 07:46:30.509935 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-906417b2-1b36-4eb2-b5ad-d77cc6dbca0b req-b9a52a9f-452b-4f2e-9049-23d9b8bd0435 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029382 May 25 07:46:30.510581 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 524/1003] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:46:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:46:31.363815 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c11185e6-3a16-4c41-8375-38f9b8efb6fe tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:31.364596 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c11185e6-3a16-4c41-8375-38f9b8efb6fe tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:31.372020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c11185e6-3a16-4c41-8375-38f9b8efb6fe tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:31.372493 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c11185e6-3a16-4c41-8375-38f9b8efb6fe tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:31.373273 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c11185e6-3a16-4c41-8375-38f9b8efb6fe tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:31.373713 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c11185e6-3a16-4c41-8375-38f9b8efb6fe tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:31.404716 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c11185e6-3a16-4c41-8375-38f9b8efb6fe tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:31.405169 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c11185e6-3a16-4c41-8375-38f9b8efb6fe tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:31.406508 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.objects.instance [None req-c11185e6-3a16-4c41-8375-38f9b8efb6fe tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lazy-loading 'fault' on Instance uuid 0904e314-a1e9-453e-9182-e709d655845a {{(pid=124674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:46:31.446622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c11185e6-3a16-4c41-8375-38f9b8efb6fe tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '820809022ed4493eb9f536c3b1fbc878', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ee2590cbdba14e7ab1f3ce5a58beeb54', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:31.454126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c11185e6-3a16-4c41-8375-38f9b8efb6fe tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a" status: 200 len: 1309 microversion: 2.1 time: 0.094173 May 25 07:46:31.454696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 480/1004] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:31 2022] GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:32.477832 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-bf65ebb0-9dea-4e7a-a232-93a315d9cf7a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:32.479160 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-bf65ebb0-9dea-4e7a-a232-93a315d9cf7a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] [instance: 0904e314-a1e9-453e-9182-e709d655845a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:32.485365 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-bf65ebb0-9dea-4e7a-a232-93a315d9cf7a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:32.485813 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-bf65ebb0-9dea-4e7a-a232-93a315d9cf7a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:32.486601 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-bf65ebb0-9dea-4e7a-a232-93a315d9cf7a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:32.487041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-bf65ebb0-9dea-4e7a-a232-93a315d9cf7a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:32.501104 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-bf65ebb0-9dea-4e7a-a232-93a315d9cf7a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] HTTP exception thrown: Instance 0904e314-a1e9-453e-9182-e709d655845a could not be found. May 25 07:46:32.502713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-bf65ebb0-9dea-4e7a-a232-93a315d9cf7a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Request method failure captured: May 25 07:46:32.502713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a HTTP/1.1 May 25 07:46:32.502713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:46:32.502713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:46:32.502713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:46:32.502713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:46:32.502713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:46:32.502713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:46:32.502713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:46:32.502713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:46:32.502713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijd5CvTV22RdhHLfOcB0db3JVCFfPfwOrSe04l6cjpEuDl3trWxbYz6rBdEaTSRtZImWz7ctBmiE0PUQNRm3jfBq6LPtONHJ1ROY9JyJ6hVr6mCHxss2eJmF6h7oF1bSmWGoJK4_1Ac73WJj2n1XoiOm03e4HgkFMIQiwHaW9S1gbVgI May 25 07:46:32.502713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:46:32.502713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:46:32.502713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:46:32.502713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:46:32.502713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:46:32.502713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:46:32.502713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: ee2590cbdba14e7ab1f3ce5a58beeb54 May 25 07:46:32.502713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1886078946 May 25 07:46:32.502713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:46:32.502713 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:46:32.504436 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ee2590cbdba14e7ab1f3ce5a58beeb54"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ee2590cbdba14e7ab1f3ce5a58beeb54"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ee2590cbdba14e7ab1f3ce5a58beeb54", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ee2590cbdba14e7ab1f3ce5a58beeb54"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:46:32.504436 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-VolumesSnapshotTestJSON-1886078946 May 25 07:46:32.504436 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: ee2590cbdba14e7ab1f3ce5a58beeb54 May 25 07:46:32.504436 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1886078946 May 25 07:46:32.504436 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-VolumesSnapshotTestJSON-1886078946-project May 25 07:46:32.504436 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:46:32.504436 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:46:32.504436 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: 820809022ed4493eb9f536c3b1fbc878 May 25 07:46:32.504436 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-VolumesSnapshotTestJSON-1886078946-project May 25 07:46:32.504436 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:46:32.504436 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance 0904e314-a1e9-453e-9182-e709d655845a could not be found. May 25 07:46:32.504436 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': '0904e314-a1e9-453e-9182-e709d655845a'} May 25 07:46:32.505434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:46:32.505434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:46:32.505434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:46:32.505434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:46:32.505434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:46:32.505434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:46:32.505434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:46:32.505434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:46:32.505434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:46:32.505434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:46:32.505434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0904e314-a1e9-453e-9182-e709d655845a could not be found. May 25 07:46:32.505434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:46:32.505434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:46:32.505434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:46:32.505434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:46:32.505434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:46:32.505434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:46:32.505434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:46:32.505434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:46:32.505434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:46:32.507051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:46:32.507051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:46:32.507051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:46:32.507051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:46:32.507051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:46:32.507051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:46:32.507051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:46:32.507051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0904e314-a1e9-453e-9182-e709d655845a could not be found. May 25 07:46:32.507051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:46:32.507051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:46:32.507051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:46:32.507051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:46:32.507051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:46:32.507051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:46:32.507051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:46:32.507051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:46:32.507051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0904e314-a1e9-453e-9182-e709d655845a could not be found. May 25 07:46:32.507051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:46:32.508691 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-bf65ebb0-9dea-4e7a-a232-93a315d9cf7a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] Returning 404 to user: Instance 0904e314-a1e9-453e-9182-e709d655845a could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:46:32.508691 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-bf65ebb0-9dea-4e7a-a232-93a315d9cf7a tempest-VolumesSnapshotTestJSON-1886078946 tempest-VolumesSnapshotTestJSON-1886078946-project] 10.222.0.24 "GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a" status: 404 len: 111 microversion: 2.1 time: 0.031029 May 25 07:46:32.508691 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 525/1005] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:32 2022] GET /compute/v2.1/servers/0904e314-a1e9-453e-9182-e709d655845a => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:46:35.456497 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-2100971d-1da7-408f-b11a-bc9fdc84cbb2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:46:35.457491 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-2100971d-1da7-408f-b11a-bc9fdc84cbb2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:35.464101 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2100971d-1da7-408f-b11a-bc9fdc84cbb2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:35.464600 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2100971d-1da7-408f-b11a-bc9fdc84cbb2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:35.465420 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2100971d-1da7-408f-b11a-bc9fdc84cbb2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:35.465856 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2100971d-1da7-408f-b11a-bc9fdc84cbb2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:35.678582 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-2100971d-1da7-408f-b11a-bc9fdc84cbb2 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "POST /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8/action" status: 202 len: 0 microversion: 2.1 time: 0.225930 May 25 07:46:35.679221 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 481/1006] 10.222.0.24 () {60 vars in 1277 bytes} [Wed May 25 07:46:35 2022] POST /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8/action => generated 0 bytes in 227 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:46:35.687305 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-83339ab0-17ea-4515-bf13-6365f338b8d5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:35.687923 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-83339ab0-17ea-4515-bf13-6365f338b8d5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:35.694368 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-83339ab0-17ea-4515-bf13-6365f338b8d5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:35.695005 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-83339ab0-17ea-4515-bf13-6365f338b8d5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:35.696311 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-83339ab0-17ea-4515-bf13-6365f338b8d5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:35.696311 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-83339ab0-17ea-4515-bf13-6365f338b8d5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:35.889798 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-83339ab0-17ea-4515-bf13-6365f338b8d5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:35.897791 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-83339ab0-17ea-4515-bf13-6365f338b8d5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1749 microversion: 2.1 time: 0.214372 May 25 07:46:35.898354 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 526/1007] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:35 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1749 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:36.916701 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7857476e-c5bb-4f4d-9e9a-41088b080256 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:36.917434 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-7857476e-c5bb-4f4d-9e9a-41088b080256 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:36.923702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7857476e-c5bb-4f4d-9e9a-41088b080256 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:36.924154 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7857476e-c5bb-4f4d-9e9a-41088b080256 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:36.924953 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7857476e-c5bb-4f4d-9e9a-41088b080256 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:36.925395 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7857476e-c5bb-4f4d-9e9a-41088b080256 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:37.065233 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7857476e-c5bb-4f4d-9e9a-41088b080256 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:37.074331 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-7857476e-c5bb-4f4d-9e9a-41088b080256 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1749 microversion: 2.1 time: 0.162335 May 25 07:46:37.075030 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 482/1008] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:36 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1749 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:38.091798 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-44469723-661a-4295-9b7e-bc8e031cd447 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:38.092362 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-44469723-661a-4295-9b7e-bc8e031cd447 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:38.099001 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-44469723-661a-4295-9b7e-bc8e031cd447 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:38.099459 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-44469723-661a-4295-9b7e-bc8e031cd447 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:38.100237 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-44469723-661a-4295-9b7e-bc8e031cd447 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:38.100714 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-44469723-661a-4295-9b7e-bc8e031cd447 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:38.242847 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-44469723-661a-4295-9b7e-bc8e031cd447 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:38.251511 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-44469723-661a-4295-9b7e-bc8e031cd447 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1749 microversion: 2.1 time: 0.164290 May 25 07:46:38.252090 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 527/1009] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:38 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1749 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:46:39.269258 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-2cc290b9-c76f-4310-ba91-566ef9a692df tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:39.269878 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-2cc290b9-c76f-4310-ba91-566ef9a692df tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:39.276595 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2cc290b9-c76f-4310-ba91-566ef9a692df tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:39.277053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2cc290b9-c76f-4310-ba91-566ef9a692df tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:39.280527 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2cc290b9-c76f-4310-ba91-566ef9a692df tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:39.280527 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2cc290b9-c76f-4310-ba91-566ef9a692df tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:39.420910 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-2cc290b9-c76f-4310-ba91-566ef9a692df tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:39.429027 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-2cc290b9-c76f-4310-ba91-566ef9a692df tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1754 microversion: 2.1 time: 0.163696 May 25 07:46:39.429607 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 483/1010] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:39 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:40.449088 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-a6bde92b-809b-4c20-a60a-e28ab430ca21 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:40.454235 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-a6bde92b-809b-4c20-a60a-e28ab430ca21 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:40.456309 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a6bde92b-809b-4c20-a60a-e28ab430ca21 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:40.456831 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a6bde92b-809b-4c20-a60a-e28ab430ca21 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:40.457610 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a6bde92b-809b-4c20-a60a-e28ab430ca21 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:40.458075 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-a6bde92b-809b-4c20-a60a-e28ab430ca21 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:40.602979 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-a6bde92b-809b-4c20-a60a-e28ab430ca21 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:40.613027 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-a6bde92b-809b-4c20-a60a-e28ab430ca21 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1754 microversion: 2.1 time: 0.167879 May 25 07:46:40.613509 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 528/1011] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:40 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:41.631460 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7ff05ad8-d052-4a61-8b2f-3c18b3a744e9 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:41.632121 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-7ff05ad8-d052-4a61-8b2f-3c18b3a744e9 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:41.639980 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7ff05ad8-d052-4a61-8b2f-3c18b3a744e9 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:41.640437 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7ff05ad8-d052-4a61-8b2f-3c18b3a744e9 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:41.641239 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7ff05ad8-d052-4a61-8b2f-3c18b3a744e9 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:41.641679 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-7ff05ad8-d052-4a61-8b2f-3c18b3a744e9 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:41.793443 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7ff05ad8-d052-4a61-8b2f-3c18b3a744e9 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:41.801462 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-7ff05ad8-d052-4a61-8b2f-3c18b3a744e9 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1754 microversion: 2.1 time: 0.173944 May 25 07:46:41.802286 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 484/1012] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:41 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1754 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:42.819963 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-0f168340-63ee-44d6-8e66-0016cf45324b tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:42.826471 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-0f168340-63ee-44d6-8e66-0016cf45324b tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:42.827733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0f168340-63ee-44d6-8e66-0016cf45324b tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:42.828188 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0f168340-63ee-44d6-8e66-0016cf45324b tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:42.828987 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0f168340-63ee-44d6-8e66-0016cf45324b tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:42.829489 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-0f168340-63ee-44d6-8e66-0016cf45324b tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:42.974755 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-0f168340-63ee-44d6-8e66-0016cf45324b tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:42.983948 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-0f168340-63ee-44d6-8e66-0016cf45324b tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1754 microversion: 2.1 time: 0.167946 May 25 07:46:42.984549 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 529/1013] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:42 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1754 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:44.002189 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-dbf70ba9-06c3-4dbf-9aed-22aac4f5065e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:44.002812 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-dbf70ba9-06c3-4dbf-9aed-22aac4f5065e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:44.009297 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-dbf70ba9-06c3-4dbf-9aed-22aac4f5065e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:44.009776 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-dbf70ba9-06c3-4dbf-9aed-22aac4f5065e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:44.010538 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-dbf70ba9-06c3-4dbf-9aed-22aac4f5065e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:44.010975 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-dbf70ba9-06c3-4dbf-9aed-22aac4f5065e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:44.149819 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-dbf70ba9-06c3-4dbf-9aed-22aac4f5065e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:44.158621 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-dbf70ba9-06c3-4dbf-9aed-22aac4f5065e tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1754 microversion: 2.1 time: 0.160985 May 25 07:46:44.159196 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 485/1014] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:43 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:45.177478 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-61485f24-d03b-462c-949e-c696fdf12f56 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:45.178108 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-61485f24-d03b-462c-949e-c696fdf12f56 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:45.186348 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-61485f24-d03b-462c-949e-c696fdf12f56 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:45.187149 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-61485f24-d03b-462c-949e-c696fdf12f56 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:45.188419 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-61485f24-d03b-462c-949e-c696fdf12f56 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:45.189183 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-61485f24-d03b-462c-949e-c696fdf12f56 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:45.358148 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-61485f24-d03b-462c-949e-c696fdf12f56 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:45.370075 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-61485f24-d03b-462c-949e-c696fdf12f56 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1754 microversion: 2.1 time: 0.196997 May 25 07:46:45.370993 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 530/1015] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:45 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1754 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:46.389280 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-412e935c-34f8-46c5-ab35-68acb6c4d177 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:46.389813 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-412e935c-34f8-46c5-ab35-68acb6c4d177 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:46.396341 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-412e935c-34f8-46c5-ab35-68acb6c4d177 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:46.396826 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-412e935c-34f8-46c5-ab35-68acb6c4d177 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:46.397595 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-412e935c-34f8-46c5-ab35-68acb6c4d177 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:46.398034 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-412e935c-34f8-46c5-ab35-68acb6c4d177 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:46.538005 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-412e935c-34f8-46c5-ab35-68acb6c4d177 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:46.546041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-412e935c-34f8-46c5-ab35-68acb6c4d177 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1754 microversion: 2.1 time: 0.161263 May 25 07:46:46.546602 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 486/1016] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:46 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1754 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:47.563244 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8f0debb4-3b06-4952-a4d9-8ba2753c897f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:47.563841 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-8f0debb4-3b06-4952-a4d9-8ba2753c897f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:47.570325 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8f0debb4-3b06-4952-a4d9-8ba2753c897f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:47.570840 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8f0debb4-3b06-4952-a4d9-8ba2753c897f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:47.571598 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8f0debb4-3b06-4952-a4d9-8ba2753c897f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:47.572034 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8f0debb4-3b06-4952-a4d9-8ba2753c897f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:47.711862 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-8f0debb4-3b06-4952-a4d9-8ba2753c897f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:47.720727 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-8f0debb4-3b06-4952-a4d9-8ba2753c897f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1754 microversion: 2.1 time: 0.161446 May 25 07:46:47.721296 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 531/1017] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:47 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1754 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:48.737733 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-053d7f06-314c-4f26-8eed-b67ee27f2056 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:48.740443 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-053d7f06-314c-4f26-8eed-b67ee27f2056 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:48.745327 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-053d7f06-314c-4f26-8eed-b67ee27f2056 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:48.745780 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-053d7f06-314c-4f26-8eed-b67ee27f2056 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:48.746548 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-053d7f06-314c-4f26-8eed-b67ee27f2056 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:48.746979 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-053d7f06-314c-4f26-8eed-b67ee27f2056 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:48.888388 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-053d7f06-314c-4f26-8eed-b67ee27f2056 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:48.896400 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-053d7f06-314c-4f26-8eed-b67ee27f2056 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1754 microversion: 2.1 time: 0.162570 May 25 07:46:48.897000 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 487/1018] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:48 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1754 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:46:49.913493 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-171a3b88-9262-4387-8b68-7256203a7194 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:46:49.914104 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-171a3b88-9262-4387-8b68-7256203a7194 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:46:49.920715 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-171a3b88-9262-4387-8b68-7256203a7194 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:49.924111 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-171a3b88-9262-4387-8b68-7256203a7194 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:49.924111 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-171a3b88-9262-4387-8b68-7256203a7194 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:46:49.924111 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-171a3b88-9262-4387-8b68-7256203a7194 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:46:50.063380 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-171a3b88-9262-4387-8b68-7256203a7194 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:46:50.071536 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-171a3b88-9262-4387-8b68-7256203a7194 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1757 microversion: 2.1 time: 0.161918 May 25 07:46:50.072115 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 532/1019] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:46:49 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1757 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:47:22.320713 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-d8663e77-c785-49c1-bd51-4fbda5a77d99 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1229247706"}} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:47:22.321291 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-d8663e77-c785-49c1-bd51-4fbda5a77d99 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:47:22.323331 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=24 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:47:22.324046 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=75,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:47:22.329184 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d8663e77-c785-49c1-bd51-4fbda5a77d99 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:22.329662 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d8663e77-c785-49c1-bd51-4fbda5a77d99 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:22.331094 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d8663e77-c785-49c1-bd51-4fbda5a77d99 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:22.331526 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-d8663e77-c785-49c1-bd51-4fbda5a77d99 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:22.457388 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.network.security_group_api [None req-d8663e77-c785-49c1-bd51-4fbda5a77d99 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Removing security group 2eda9b78-83a3-474a-99fa-0c7398f998bc from port eed8a0c9-0f18-40ef-a65e-38b52e79aa6e May 25 07:47:22.876070 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-d8663e77-c785-49c1-bd51-4fbda5a77d99 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "POST /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8/action" status: 202 len: 0 microversion: 2.1 time: 0.559501 May 25 07:47:22.889357 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-67b20ea2-9bf2-4d0c-b151-116f31485c4b req-cb42eec0-583f-447d-b087-65cd1ecb9bae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "892bc459-4577-4e8c-b87f-04861e9f1ea8", "tag": "eed8a0c9-0f18-40ef-a65e-38b52e79aa6e"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:47:22.893502 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 488/1020] 10.222.0.24 () {60 vars in 1277 bytes} [Wed May 25 07:47:22 2022] POST /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8/action => generated 0 bytes in 577 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) May 25 07:47:22.909896 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=1 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:47:22.910631 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=66,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:47:22.912625 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-67b20ea2-9bf2-4d0c-b151-116f31485c4b req-cb42eec0-583f-447d-b087-65cd1ecb9bae service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:22.913086 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-67b20ea2-9bf2-4d0c-b151-116f31485c4b req-cb42eec0-583f-447d-b087-65cd1ecb9bae service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:22.926246 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-67b20ea2-9bf2-4d0c-b151-116f31485c4b req-cb42eec0-583f-447d-b087-65cd1ecb9bae service nova] Creating event network-changed:eed8a0c9-0f18-40ef-a65e-38b52e79aa6e for instance 892bc459-4577-4e8c-b87f-04861e9f1ea8 on hv-cinder-82549 May 25 07:47:22.934483 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-67b20ea2-9bf2-4d0c-b151-116f31485c4b req-cb42eec0-583f-447d-b087-65cd1ecb9bae service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048855 May 25 07:47:22.935800 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 533/1021] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:47:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:47:24.369091 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c284706e-7f82-466f-bff0-4c22ac2cf4a3 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:47:24.369627 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c284706e-7f82-466f-bff0-4c22ac2cf4a3 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:47:24.375525 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c284706e-7f82-466f-bff0-4c22ac2cf4a3 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:24.375975 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c284706e-7f82-466f-bff0-4c22ac2cf4a3 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:24.376796 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c284706e-7f82-466f-bff0-4c22ac2cf4a3 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:24.377215 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c284706e-7f82-466f-bff0-4c22ac2cf4a3 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:24.457684 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.objects.instance [None req-c284706e-7f82-466f-bff0-4c22ac2cf4a3 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lazy-loading 'services' on Instance uuid 892bc459-4577-4e8c-b87f-04861e9f1ea8 {{(pid=124674) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:47:24.661845 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c284706e-7f82-466f-bff0-4c22ac2cf4a3 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "DELETE /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8/os-volume_attachments/25f1080c-a4f2-4a5b-bf52-058e0e512e1f" status: 202 len: 0 microversion: 2.1 time: 0.297493 May 25 07:47:24.662567 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 489/1022] 10.222.0.24 () {58 vars in 1415 bytes} [Wed May 25 07:47:24 2022] DELETE /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8/os-volume_attachments/25f1080c-a4f2-4a5b-bf52-058e0e512e1f => generated 0 bytes in 299 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:47:24.672560 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-af1c9e81-0c88-4860-b149-1b17ef7a8a17 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:47:24.674498 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-af1c9e81-0c88-4860-b149-1b17ef7a8a17 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:47:24.682949 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-af1c9e81-0c88-4860-b149-1b17ef7a8a17 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:24.683403 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-af1c9e81-0c88-4860-b149-1b17ef7a8a17 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:24.684187 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-af1c9e81-0c88-4860-b149-1b17ef7a8a17 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:24.684660 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-af1c9e81-0c88-4860-b149-1b17ef7a8a17 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:24.715677 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-af1c9e81-0c88-4860-b149-1b17ef7a8a17 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048404 May 25 07:47:24.716255 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 534/1023] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:47:24 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:47:24.950643 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-8ac0c4bb-e98b-4aea-992a-33be8810a5be req-8f8e52c6-25aa-4a96-8bb5-42e1ac8f80c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "892bc459-4577-4e8c-b87f-04861e9f1ea8", "tag": "eed8a0c9-0f18-40ef-a65e-38b52e79aa6e"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:47:24.959282 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-8ac0c4bb-e98b-4aea-992a-33be8810a5be req-8f8e52c6-25aa-4a96-8bb5-42e1ac8f80c7 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:24.959812 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-8ac0c4bb-e98b-4aea-992a-33be8810a5be req-8f8e52c6-25aa-4a96-8bb5-42e1ac8f80c7 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:24.970696 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-8ac0c4bb-e98b-4aea-992a-33be8810a5be req-8f8e52c6-25aa-4a96-8bb5-42e1ac8f80c7 service nova] Creating event network-changed:eed8a0c9-0f18-40ef-a65e-38b52e79aa6e for instance 892bc459-4577-4e8c-b87f-04861e9f1ea8 on hv-cinder-82549 May 25 07:47:24.975798 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-8ac0c4bb-e98b-4aea-992a-33be8810a5be req-8f8e52c6-25aa-4a96-8bb5-42e1ac8f80c7 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028995 May 25 07:47:24.976174 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 490/1024] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:47:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:47:25.730341 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-5d743dc7-6eb6-4dab-9c2d-f32d2a434afe tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:47:25.733208 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-5d743dc7-6eb6-4dab-9c2d-f32d2a434afe tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:47:25.740940 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5d743dc7-6eb6-4dab-9c2d-f32d2a434afe tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:25.741439 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5d743dc7-6eb6-4dab-9c2d-f32d2a434afe tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:25.742278 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5d743dc7-6eb6-4dab-9c2d-f32d2a434afe tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:25.742727 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5d743dc7-6eb6-4dab-9c2d-f32d2a434afe tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:25.772094 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-5d743dc7-6eb6-4dab-9c2d-f32d2a434afe tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048061 May 25 07:47:25.772675 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 535/1025] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:47:25 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:47:26.785010 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-987052a2-4023-4b13-b3d2-840d485de47f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:47:26.786124 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-987052a2-4023-4b13-b3d2-840d485de47f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:47:26.792419 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-987052a2-4023-4b13-b3d2-840d485de47f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:26.796636 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-987052a2-4023-4b13-b3d2-840d485de47f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:26.796636 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-987052a2-4023-4b13-b3d2-840d485de47f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:26.796636 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-987052a2-4023-4b13-b3d2-840d485de47f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:26.822682 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-987052a2-4023-4b13-b3d2-840d485de47f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043196 May 25 07:47:26.823240 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 491/1026] 10.222.0.24 () {58 vars in 1301 bytes} [Wed May 25 07:47:26 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) May 25 07:47:26.833035 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4b422c6f-a4c0-4237-89ac-8f3c1ac7a921 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:47:26.833572 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-4b422c6f-a4c0-4237-89ac-8f3c1ac7a921 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:47:26.840373 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4b422c6f-a4c0-4237-89ac-8f3c1ac7a921 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:26.840861 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4b422c6f-a4c0-4237-89ac-8f3c1ac7a921 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:26.841634 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4b422c6f-a4c0-4237-89ac-8f3c1ac7a921 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:26.842077 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-4b422c6f-a4c0-4237-89ac-8f3c1ac7a921 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:26.915794 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-4b422c6f-a4c0-4237-89ac-8f3c1ac7a921 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] HTTP exception thrown: Instance 892bc459-4577-4e8c-b87f-04861e9f1ea8 is not attached to volume 25f1080c-a4f2-4a5b-bf52-058e0e512e1f May 25 07:47:26.918214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4b422c6f-a4c0-4237-89ac-8f3c1ac7a921 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Request method failure captured: May 25 07:47:26.918214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: DELETE /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8/os-volume_attachments/25f1080c-a4f2-4a5b-bf52-058e0e512e1f HTTP/1.1 May 25 07:47:26.918214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:47:26.918214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:47:26.918214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:47:26.918214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:47:26.918214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:47:26.918214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:47:26.918214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:47:26.918214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:47:26.918214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijd6BX2eD0bKpyd_DfzM0Ced_9h3s3tSxQCxqojiLe-w0P7jTUH6tql4fZs9GpXsrfBt9k91wr8u2ywARhQtbafrgNXc_xonBd0nfOmINVMM0r32reNZoVPwuxuVVICyGgYGkdT7dpDL3kfA1KUY7LJVGsMVrxy1ZkryWDFOEJc1GiY8 May 25 07:47:26.918214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:47:26.918214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:47:26.918214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:47:26.918214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:47:26.918214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:47:26.918214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:47:26.918214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: ce3e8f3592894606afc4d35c82d8f36f May 25 07:47:26.918214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-TestMinimumBasicScenario-1136131971 May 25 07:47:26.918214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:47:26.918214 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:47:26.919881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ce3e8f3592894606afc4d35c82d8f36f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ce3e8f3592894606afc4d35c82d8f36f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ce3e8f3592894606afc4d35c82d8f36f", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ce3e8f3592894606afc4d35c82d8f36f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:47:26.919881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-TestMinimumBasicScenario-1136131971 May 25 07:47:26.919881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: ce3e8f3592894606afc4d35c82d8f36f May 25 07:47:26.919881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1136131971 May 25 07:47:26.919881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-TestMinimumBasicScenario-1136131971-project May 25 07:47:26.919881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:47:26.919881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:47:26.919881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: b003492ec6a8434fb778f017b07e8697 May 25 07:47:26.919881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-TestMinimumBasicScenario-1136131971-project May 25 07:47:26.919881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:47:26.919881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance 892bc459-4577-4e8c-b87f-04861e9f1ea8 is not attached to volume 25f1080c-a4f2-4a5b-bf52-058e0e512e1f May 25 07:47:26.920917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'server_id': '892bc459-4577-4e8c-b87f-04861e9f1ea8', 'id': '25f1080c-a4f2-4a5b-bf52-058e0e512e1f'} May 25 07:47:26.920917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:47:26.920917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:47:26.920917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete May 25 07:47:26.920917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( May 25 07:47:26.920917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper May 25 07:47:26.920917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) May 25 07:47:26.920917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance May 25 07:47:26.920917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) May 25 07:47:26.920917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 25f1080c-a4f2-4a5b-bf52-058e0e512e1f. May 25 07:47:26.920917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:47:26.920917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:47:26.920917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:47:26.920917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:47:26.920917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:47:26.920917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:47:26.920917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:47:26.920917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:47:26.920917 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:47:26.922490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:47:26.922490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete May 25 07:47:26.922490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) May 25 07:47:26.922490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 892bc459-4577-4e8c-b87f-04861e9f1ea8 is not attached to volume 25f1080c-a4f2-4a5b-bf52-058e0e512e1f May 25 07:47:26.922490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:47:26.922490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:47:26.922490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:47:26.922490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:47:26.922490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:47:26.922490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:47:26.922490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:47:26.922490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:47:26.922490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 892bc459-4577-4e8c-b87f-04861e9f1ea8 is not attached to volume 25f1080c-a4f2-4a5b-bf52-058e0e512e1f May 25 07:47:26.922490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:47:26.922490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-4b422c6f-a4c0-4237-89ac-8f3c1ac7a921 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Returning 404 to user: Instance 892bc459-4577-4e8c-b87f-04861e9f1ea8 is not attached to volume 25f1080c-a4f2-4a5b-bf52-058e0e512e1f {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:47:26.924506 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-4b422c6f-a4c0-4237-89ac-8f3c1ac7a921 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "DELETE /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8/os-volume_attachments/25f1080c-a4f2-4a5b-bf52-058e0e512e1f" status: 404 len: 154 microversion: 2.1 time: 0.090751 May 25 07:47:26.924506 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 536/1027] 10.222.0.24 () {58 vars in 1415 bytes} [Wed May 25 07:47:26 2022] DELETE /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8/os-volume_attachments/25f1080c-a4f2-4a5b-bf52-058e0e512e1f => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:47:28.168879 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-3825bc3b-198f-4efa-a9a4-e2aae03d02b5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:47:28.169410 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-3825bc3b-198f-4efa-a9a4-e2aae03d02b5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:47:28.176227 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3825bc3b-198f-4efa-a9a4-e2aae03d02b5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:28.176715 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3825bc3b-198f-4efa-a9a4-e2aae03d02b5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:28.177481 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3825bc3b-198f-4efa-a9a4-e2aae03d02b5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:28.177919 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3825bc3b-198f-4efa-a9a4-e2aae03d02b5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:28.201377 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-3825bc3b-198f-4efa-a9a4-e2aae03d02b5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Going to try to terminate instance {{(pid=124674) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:47:28.421167 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-3825bc3b-198f-4efa-a9a4-e2aae03d02b5 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "DELETE /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 204 len: 0 microversion: 2.1 time: 0.255929 May 25 07:47:28.421720 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 492/1028] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:47:28 2022] DELETE /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 0 bytes in 257 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 07:47:28.430500 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-2f9dcf09-03aa-4bdf-9e34-a9f9cede3e08 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:47:28.432053 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-2f9dcf09-03aa-4bdf-9e34-a9f9cede3e08 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:47:28.437589 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2f9dcf09-03aa-4bdf-9e34-a9f9cede3e08 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:28.438051 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2f9dcf09-03aa-4bdf-9e34-a9f9cede3e08 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:28.438829 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2f9dcf09-03aa-4bdf-9e34-a9f9cede3e08 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:28.439412 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2f9dcf09-03aa-4bdf-9e34-a9f9cede3e08 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:28.569505 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-2f9dcf09-03aa-4bdf-9e34-a9f9cede3e08 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:47:28.577174 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-2f9dcf09-03aa-4bdf-9e34-a9f9cede3e08 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1552 microversion: 2.1 time: 0.150598 May 25 07:47:28.577758 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 537/1029] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:47:28 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:47:29.596365 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-26573230-7e34-4aa8-9b85-c8f293b4d3c6 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:47:29.597090 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-26573230-7e34-4aa8-9b85-c8f293b4d3c6 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:47:29.603480 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-26573230-7e34-4aa8-9b85-c8f293b4d3c6 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:29.603925 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-26573230-7e34-4aa8-9b85-c8f293b4d3c6 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:29.604737 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-26573230-7e34-4aa8-9b85-c8f293b4d3c6 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:29.605177 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-26573230-7e34-4aa8-9b85-c8f293b4d3c6 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:29.736714 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-26573230-7e34-4aa8-9b85-c8f293b4d3c6 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:47:29.744594 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-26573230-7e34-4aa8-9b85-c8f293b4d3c6 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1552 microversion: 2.1 time: 0.153091 May 25 07:47:29.745157 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 493/1030] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:47:29 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1552 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:47:30.762326 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-432232fb-eb29-4a99-8845-b1a8edef235f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:47:30.762940 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-432232fb-eb29-4a99-8845-b1a8edef235f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:47:30.770655 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-432232fb-eb29-4a99-8845-b1a8edef235f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:30.771115 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-432232fb-eb29-4a99-8845-b1a8edef235f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:30.771954 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-432232fb-eb29-4a99-8845-b1a8edef235f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:30.772391 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-432232fb-eb29-4a99-8845-b1a8edef235f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:30.907697 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-432232fb-eb29-4a99-8845-b1a8edef235f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:47:30.915742 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-432232fb-eb29-4a99-8845-b1a8edef235f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1552 microversion: 2.1 time: 0.157424 May 25 07:47:30.916298 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 538/1031] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:47:30 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1552 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:47:31.036050 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-aa3b74a0-d915-4ea5-87b2-351084767ba0 req-1c5cc04d-3dc7-4300-8d54-698fbd6d21b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "892bc459-4577-4e8c-b87f-04861e9f1ea8", "name": "network-vif-deleted", "tag": "eed8a0c9-0f18-40ef-a65e-38b52e79aa6e"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:47:31.044629 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-aa3b74a0-d915-4ea5-87b2-351084767ba0 req-1c5cc04d-3dc7-4300-8d54-698fbd6d21b8 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:31.045078 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-aa3b74a0-d915-4ea5-87b2-351084767ba0 req-1c5cc04d-3dc7-4300-8d54-698fbd6d21b8 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:31.055855 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-aa3b74a0-d915-4ea5-87b2-351084767ba0 req-1c5cc04d-3dc7-4300-8d54-698fbd6d21b8 service nova] Creating event network-vif-deleted:eed8a0c9-0f18-40ef-a65e-38b52e79aa6e for instance 892bc459-4577-4e8c-b87f-04861e9f1ea8 on hv-cinder-82549 May 25 07:47:31.060974 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-aa3b74a0-d915-4ea5-87b2-351084767ba0 req-1c5cc04d-3dc7-4300-8d54-698fbd6d21b8 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029422 May 25 07:47:31.067589 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 494/1032] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:47:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:47:31.931929 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-87fca059-f054-4cc4-9c5b-429f584e4cd7 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:47:31.932573 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-87fca059-f054-4cc4-9c5b-429f584e4cd7 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:47:31.939216 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-87fca059-f054-4cc4-9c5b-429f584e4cd7 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:31.945384 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-87fca059-f054-4cc4-9c5b-429f584e4cd7 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:31.945384 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-87fca059-f054-4cc4-9c5b-429f584e4cd7 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:31.945384 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-87fca059-f054-4cc4-9c5b-429f584e4cd7 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:31.974105 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-87fca059-f054-4cc4-9c5b-429f584e4cd7 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:31.974561 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-87fca059-f054-4cc4-9c5b-429f584e4cd7 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:31.975024 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.objects.instance [None req-87fca059-f054-4cc4-9c5b-429f584e4cd7 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lazy-loading 'fault' on Instance uuid 892bc459-4577-4e8c-b87f-04861e9f1ea8 {{(pid=124675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:47:32.015337 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-87fca059-f054-4cc4-9c5b-429f584e4cd7 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'b003492ec6a8434fb778f017b07e8697', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ce3e8f3592894606afc4d35c82d8f36f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:47:32.023030 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-87fca059-f054-4cc4-9c5b-429f584e4cd7 tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 200 len: 1347 microversion: 2.1 time: 0.095036 May 25 07:47:32.023598 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 539/1033] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:47:31 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 1347 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:47:33.040998 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-6f77d5a9-3513-4ff8-9234-8ba179ddcf6f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:47:33.041700 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-6f77d5a9-3513-4ff8-9234-8ba179ddcf6f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] [instance: 892bc459-4577-4e8c-b87f-04861e9f1ea8] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:47:33.049061 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6f77d5a9-3513-4ff8-9234-8ba179ddcf6f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:33.049542 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6f77d5a9-3513-4ff8-9234-8ba179ddcf6f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:33.050413 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6f77d5a9-3513-4ff8-9234-8ba179ddcf6f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:47:33.050853 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-6f77d5a9-3513-4ff8-9234-8ba179ddcf6f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:47:33.063935 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-6f77d5a9-3513-4ff8-9234-8ba179ddcf6f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] HTTP exception thrown: Instance 892bc459-4577-4e8c-b87f-04861e9f1ea8 could not be found. May 25 07:47:33.066352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-6f77d5a9-3513-4ff8-9234-8ba179ddcf6f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Request method failure captured: May 25 07:47:33.066352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 HTTP/1.1 May 25 07:47:33.066352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:47:33.066352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:47:33.066352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:47:33.066352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:47:33.066352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:47:33.066352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:47:33.066352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:47:33.066352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:47:33.066352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijd6BX2eD0bKpyd_DfzM0Ced_9h3s3tSxQCxqojiLe-w0P7jTUH6tql4fZs9GpXsrfBt9k91wr8u2ywARhQtbafrgNXc_xonBd0nfOmINVMM0r32reNZoVPwuxuVVICyGgYGkdT7dpDL3kfA1KUY7LJVGsMVrxy1ZkryWDFOEJc1GiY8 May 25 07:47:33.066352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:47:33.066352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:47:33.066352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:47:33.066352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:47:33.066352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:47:33.066352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:47:33.066352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: ce3e8f3592894606afc4d35c82d8f36f May 25 07:47:33.066352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-TestMinimumBasicScenario-1136131971 May 25 07:47:33.066352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:47:33.066352 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:47:33.068039 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ce3e8f3592894606afc4d35c82d8f36f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/ce3e8f3592894606afc4d35c82d8f36f"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_ce3e8f3592894606afc4d35c82d8f36f", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/ce3e8f3592894606afc4d35c82d8f36f"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:47:33.068039 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-TestMinimumBasicScenario-1136131971 May 25 07:47:33.068039 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: ce3e8f3592894606afc4d35c82d8f36f May 25 07:47:33.068039 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1136131971 May 25 07:47:33.068039 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-TestMinimumBasicScenario-1136131971-project May 25 07:47:33.068039 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:47:33.068039 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:47:33.068039 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: b003492ec6a8434fb778f017b07e8697 May 25 07:47:33.068039 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-TestMinimumBasicScenario-1136131971-project May 25 07:47:33.068039 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:47:33.068039 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Instance 892bc459-4577-4e8c-b87f-04861e9f1ea8 could not be found. May 25 07:47:33.068039 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': '892bc459-4577-4e8c-b87f-04861e9f1ea8'} May 25 07:47:33.069126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:47:33.069126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:47:33.069126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:47:33.069126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:47:33.069126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:47:33.069126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:47:33.069126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:47:33.069126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:47:33.069126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:47:33.069126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:47:33.069126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 892bc459-4577-4e8c-b87f-04861e9f1ea8 could not be found. May 25 07:47:33.069126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:47:33.069126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:47:33.069126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:47:33.069126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:47:33.069126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:47:33.069126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:47:33.069126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:47:33.069126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:47:33.069126 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:47:33.070702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:47:33.070702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:47:33.070702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:47:33.070702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:47:33.070702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:47:33.070702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:47:33.070702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:47:33.070702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 892bc459-4577-4e8c-b87f-04861e9f1ea8 could not be found. May 25 07:47:33.070702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:47:33.070702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:47:33.070702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:47:33.070702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:47:33.070702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:47:33.070702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:47:33.070702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:47:33.070702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:47:33.070702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 892bc459-4577-4e8c-b87f-04861e9f1ea8 could not be found. May 25 07:47:33.070702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:47:33.072570 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-6f77d5a9-3513-4ff8-9234-8ba179ddcf6f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Returning 404 to user: Instance 892bc459-4577-4e8c-b87f-04861e9f1ea8 could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:47:33.072570 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-6f77d5a9-3513-4ff8-9234-8ba179ddcf6f tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8" status: 404 len: 111 microversion: 2.1 time: 0.031109 May 25 07:47:33.072570 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 495/1034] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:47:33 2022] GET /compute/v2.1/servers/892bc459-4577-4e8c-b87f-04861e9f1ea8 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:47:33.076382 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-ded90e48-7404-4737-9174-c937726224cd tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] Calling method '.version_select at 0x7fc8656f3940>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:47:33.161025 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-ded90e48-7404-4737-9174-c937726224cd tempest-TestMinimumBasicScenario-1136131971 tempest-TestMinimumBasicScenario-1136131971-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-11457544" status: 202 len: 0 microversion: 2.1 time: 0.088387 May 25 07:47:33.161608 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 540/1035] 10.222.0.24 () {58 vars in 1265 bytes} [Wed May 25 07:47:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-11457544 => generated 0 bytes in 90 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:48:08.306907 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-00ff550a-9358-4868-a1b4-9db9138c2212 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:08.307457 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-00ff550a-9358-4868-a1b4-9db9138c2212 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:08.309673 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=21,nova_api:UPDATE=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:48:08.310331 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=45,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:48:08.315122 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-00ff550a-9358-4868-a1b4-9db9138c2212 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:08.315576 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-00ff550a-9358-4868-a1b4-9db9138c2212 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:08.317214 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-00ff550a-9358-4868-a1b4-9db9138c2212 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:08.323466 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-00ff550a-9358-4868-a1b4-9db9138c2212 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:08.342394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-00ff550a-9358-4868-a1b4-9db9138c2212 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Going to try to terminate instance {{(pid=124674) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:48:08.543318 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-00ff550a-9358-4868-a1b4-9db9138c2212 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "DELETE /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 204 len: 0 microversion: 2.1 time: 0.240135 May 25 07:48:08.543940 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 496/1036] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:48:08 2022] DELETE /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 0 bytes in 242 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 07:48:08.549520 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=40 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:48:08.550406 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=19,nova_api:DELETE=1 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:48:08.554881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-96de25a2-3d87-4364-a20d-5110adc58836 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:08.555495 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-96de25a2-3d87-4364-a20d-5110adc58836 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:08.561786 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-96de25a2-3d87-4364-a20d-5110adc58836 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:08.562179 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-96de25a2-3d87-4364-a20d-5110adc58836 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:08.562948 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-96de25a2-3d87-4364-a20d-5110adc58836 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:08.563386 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-96de25a2-3d87-4364-a20d-5110adc58836 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:08.701584 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-96de25a2-3d87-4364-a20d-5110adc58836 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:08.709360 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-96de25a2-3d87-4364-a20d-5110adc58836 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1578 microversion: 2.1 time: 0.161300 May 25 07:48:08.709921 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 541/1037] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:08 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1578 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:48:09.726865 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-ad1c6a78-076e-4292-922e-f47e95f18be5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:09.727558 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-ad1c6a78-076e-4292-922e-f47e95f18be5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:09.734055 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ad1c6a78-076e-4292-922e-f47e95f18be5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:09.734518 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ad1c6a78-076e-4292-922e-f47e95f18be5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:09.735278 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ad1c6a78-076e-4292-922e-f47e95f18be5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:09.735712 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ad1c6a78-076e-4292-922e-f47e95f18be5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:09.865122 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-ad1c6a78-076e-4292-922e-f47e95f18be5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:09.873094 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-ad1c6a78-076e-4292-922e-f47e95f18be5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1578 microversion: 2.1 time: 0.150601 May 25 07:48:09.873668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 497/1038] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:09 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1578 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:48:10.890831 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-63503dac-8472-4470-8f68-ede1c7036e6f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:10.891463 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-63503dac-8472-4470-8f68-ede1c7036e6f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:10.899011 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-63503dac-8472-4470-8f68-ede1c7036e6f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:10.904262 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-63503dac-8472-4470-8f68-ede1c7036e6f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:10.904262 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-63503dac-8472-4470-8f68-ede1c7036e6f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:10.904262 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-63503dac-8472-4470-8f68-ede1c7036e6f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:10.962815 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-63503dac-8472-4470-8f68-ede1c7036e6f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:10.970411 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-63503dac-8472-4470-8f68-ede1c7036e6f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1510 microversion: 2.1 time: 0.083523 May 25 07:48:10.970971 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 542/1039] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:10 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1510 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:48:11.321951 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-c4861b9f-f82b-4ac2-aa6e-dd5082aefc3e req-9fe588a5-2236-4682-a6b9-4523baf3c296 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "684d03bd-f960-4032-8299-19dc8fa3029e", "name": "network-vif-deleted", "tag": "4241ca06-1fe2-4402-b408-b4b6b705733f"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:48:11.331180 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-c4861b9f-f82b-4ac2-aa6e-dd5082aefc3e req-9fe588a5-2236-4682-a6b9-4523baf3c296 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:11.331635 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-c4861b9f-f82b-4ac2-aa6e-dd5082aefc3e req-9fe588a5-2236-4682-a6b9-4523baf3c296 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:11.343937 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-c4861b9f-f82b-4ac2-aa6e-dd5082aefc3e req-9fe588a5-2236-4682-a6b9-4523baf3c296 service nova] Creating event network-vif-deleted:4241ca06-1fe2-4402-b408-b4b6b705733f for instance 684d03bd-f960-4032-8299-19dc8fa3029e on hv-cinder-82549 May 25 07:48:11.349304 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-c4861b9f-f82b-4ac2-aa6e-dd5082aefc3e req-9fe588a5-2236-4682-a6b9-4523baf3c296 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.297594 May 25 07:48:11.350080 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 498/1040] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:48:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:48:11.987993 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-64b61564-05f8-45df-958f-1ed7403cf808 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:11.988639 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-64b61564-05f8-45df-958f-1ed7403cf808 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:11.996004 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-64b61564-05f8-45df-958f-1ed7403cf808 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:11.996460 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-64b61564-05f8-45df-958f-1ed7403cf808 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:11.997555 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-64b61564-05f8-45df-958f-1ed7403cf808 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:11.997993 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-64b61564-05f8-45df-958f-1ed7403cf808 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:12.029739 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-64b61564-05f8-45df-958f-1ed7403cf808 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:12.030454 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-64b61564-05f8-45df-958f-1ed7403cf808 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:12.030902 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.objects.instance [None req-64b61564-05f8-45df-958f-1ed7403cf808 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lazy-loading 'fault' on Instance uuid 684d03bd-f960-4032-8299-19dc8fa3029e {{(pid=124675) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} May 25 07:48:12.075787 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-64b61564-05f8-45df-958f-1ed7403cf808 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:12.080839 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-64b61564-05f8-45df-958f-1ed7403cf808 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 200 len: 1230 microversion: 2.1 time: 0.096930 May 25 07:48:12.081411 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 543/1041] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:11 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 1230 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:48:13.099609 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-da4477b7-a6ce-4491-b968-91a7877fb49b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:13.100640 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-da4477b7-a6ce-4491-b968-91a7877fb49b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:13.106890 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-da4477b7-a6ce-4491-b968-91a7877fb49b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:13.107377 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-da4477b7-a6ce-4491-b968-91a7877fb49b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:13.108153 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-da4477b7-a6ce-4491-b968-91a7877fb49b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:13.108622 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-da4477b7-a6ce-4491-b968-91a7877fb49b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:13.122471 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-da4477b7-a6ce-4491-b968-91a7877fb49b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] HTTP exception thrown: Instance 684d03bd-f960-4032-8299-19dc8fa3029e could not be found. May 25 07:48:13.124139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-da4477b7-a6ce-4491-b968-91a7877fb49b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Request method failure captured: May 25 07:48:13.124139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e HTTP/1.1 May 25 07:48:13.124139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:48:13.124139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:48:13.124139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:48:13.124139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:48:13.124139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:48:13.124139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:48:13.124139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:48:13.124139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:48:13.124139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijd57bFC1IiSdTlbYYsvoilbc5KwdrCZKOoMVu8rRzkpnes7s45pWmLmoCnoybBzG8bjsBfz2IUwlx4dHm-RTT4B22FVpWSU2wDDfwSW5jOju8smTl0uc7SaaDHs4CVYphiOCsAQNpSRxwUedljW86iB3aivZs6jCes4CTX8e1SrsSO4 May 25 07:48:13.124139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:48:13.124139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:48:13.124139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:48:13.124139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:48:13.124139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:48:13.124139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:48:13.124139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: f5e67d0f06be415794efd436655904b3 May 25 07:48:13.124139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-TestVolumeBootPattern-1147907125 May 25 07:48:13.124139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:48:13.124139 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:48:13.126049 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f5e67d0f06be415794efd436655904b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/f5e67d0f06be415794efd436655904b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_f5e67d0f06be415794efd436655904b3", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f5e67d0f06be415794efd436655904b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:48:13.126049 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-TestVolumeBootPattern-1147907125 May 25 07:48:13.126049 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: f5e67d0f06be415794efd436655904b3 May 25 07:48:13.126049 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-TestVolumeBootPattern-1147907125 May 25 07:48:13.126049 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-TestVolumeBootPattern-1147907125-project May 25 07:48:13.126049 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:48:13.126049 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:48:13.126049 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: d3d92c0c69cf470e8aecb57e79e5a7fe May 25 07:48:13.126049 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-TestVolumeBootPattern-1147907125-project May 25 07:48:13.126049 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:48:13.126049 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Instance 684d03bd-f960-4032-8299-19dc8fa3029e could not be found. May 25 07:48:13.126049 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': '684d03bd-f960-4032-8299-19dc8fa3029e'} May 25 07:48:13.127136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:48:13.127136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:48:13.127136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:48:13.127136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:48:13.127136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:48:13.127136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:48:13.127136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:48:13.127136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:48:13.127136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:48:13.127136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:48:13.127136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 684d03bd-f960-4032-8299-19dc8fa3029e could not be found. May 25 07:48:13.127136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:48:13.127136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:48:13.127136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:48:13.127136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:48:13.127136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:48:13.127136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:48:13.127136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:48:13.127136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:48:13.127136 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:48:13.128704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:48:13.128704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:48:13.128704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:48:13.128704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:48:13.128704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:48:13.128704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:48:13.128704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:48:13.128704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 684d03bd-f960-4032-8299-19dc8fa3029e could not be found. May 25 07:48:13.128704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:48:13.128704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:48:13.128704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:48:13.128704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:48:13.128704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:48:13.128704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:48:13.128704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:48:13.128704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:48:13.128704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 684d03bd-f960-4032-8299-19dc8fa3029e could not be found. May 25 07:48:13.128704 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:48:13.129967 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-da4477b7-a6ce-4491-b968-91a7877fb49b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Returning 404 to user: Instance 684d03bd-f960-4032-8299-19dc8fa3029e could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:48:13.129967 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-da4477b7-a6ce-4491-b968-91a7877fb49b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 404 len: 111 microversion: 2.1 time: 0.030698 May 25 07:48:13.129967 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 499/1042] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:13 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:48:13.221680 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-55a5d833-bf41-4f76-a0d9-9ff583d5466f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1852095244", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1927951084", "security_groups": [{"name": "tempest-secgroup-smoke-2067050148"}], "block_device_mapping_v2": [{"uuid": "51d403cc-8a57-42ad-b3c2-8324db43ae76", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9bcd68e9-0045-4b34-8142-bf28d91642fb"}]}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:48:13.333223 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.network.neutron [None req-55a5d833-bf41-4f76-a0d9-9ff583d5466f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] validate_networks() for [('9bcd68e9-0045-4b34-8142-bf28d91642fb', None, None, None, None, None)] {{(pid=124675) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:48:13.821567 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-55a5d833-bf41-4f76-a0d9-9ff583d5466f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Flavor limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:48:13.822002 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-55a5d833-bf41-4f76-a0d9-9ff583d5466f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Image limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:48:13.822498 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-55a5d833-bf41-4f76-a0d9-9ff583d5466f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Flavor pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:48:13.822913 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-55a5d833-bf41-4f76-a0d9-9ff583d5466f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Image pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:48:13.823333 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-55a5d833-bf41-4f76-a0d9-9ff583d5466f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:48:13.832134 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-55a5d833-bf41-4f76-a0d9-9ff583d5466f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:13.832646 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-55a5d833-bf41-4f76-a0d9-9ff583d5466f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:13.833450 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-55a5d833-bf41-4f76-a0d9-9ff583d5466f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:13.833894 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-55a5d833-bf41-4f76-a0d9-9ff583d5466f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:13.851111 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-55a5d833-bf41-4f76-a0d9-9ff583d5466f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Getting quotas for project f5e67d0f06be415794efd436655904b3. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:48:13.855156 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-55a5d833-bf41-4f76-a0d9-9ff583d5466f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Getting quotas for user d3d92c0c69cf470e8aecb57e79e5a7fe and project f5e67d0f06be415794efd436655904b3. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:48:13.912789 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-55a5d833-bf41-4f76-a0d9-9ff583d5466f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Going to run 1 instances... {{(pid=124675) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:48:13.914916 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-55a5d833-bf41-4f76-a0d9-9ff583d5466f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='51d403cc-8a57-42ad-b3c2-8324db43ae76',volume_size=None,volume_type=None)] {{(pid=124675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:48:14.311257 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR oslo.messaging._drivers.impl_rabbit [None req-55a5d833-bf41-4f76-a0d9-9ff583d5466f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [aaa8b14c-8401-49dd-b7bc-601c2352674b] AMQP server on 10.222.0.24:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer May 25 07:48:15.318026 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO oslo.messaging._drivers.impl_rabbit [None req-55a5d833-bf41-4f76-a0d9-9ff583d5466f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [aaa8b14c-8401-49dd-b7bc-601c2352674b] Reconnected to AMQP server on 10.222.0.24:5672 via [amqp] client with port 55398. May 25 07:48:15.322342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-55a5d833-bf41-4f76-a0d9-9ff583d5466f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 2.104654 May 25 07:48:15.323138 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 544/1043] 10.222.0.24 () {60 vars in 1146 bytes} [Wed May 25 07:48:13 2022] POST /compute/v2.1/servers => generated 406 bytes in 2106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 07:48:15.332972 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-25604052-607c-4ee4-abad-608013207a63 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:15.333582 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-25604052-607c-4ee4-abad-608013207a63 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:15.386606 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-25604052-607c-4ee4-abad-608013207a63 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:15.393923 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-25604052-607c-4ee4-abad-608013207a63 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1095 microversion: 2.1 time: 0.064799 May 25 07:48:15.394470 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 500/1044] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:15 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:48:16.410388 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-7be3edd5-278a-4b43-971e-ceb56423ac73 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:16.411016 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-7be3edd5-278a-4b43-971e-ceb56423ac73 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:16.463819 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-7be3edd5-278a-4b43-971e-ceb56423ac73 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:16.470471 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-7be3edd5-278a-4b43-971e-ceb56423ac73 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1095 microversion: 2.1 time: 0.064413 May 25 07:48:16.471028 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 545/1045] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:16 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1095 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:48:17.488029 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-7446cb69-430c-48c1-bd49-ff4f4409f1c3 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:17.488678 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-7446cb69-430c-48c1-bd49-ff4f4409f1c3 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:17.573955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-7446cb69-430c-48c1-bd49-ff4f4409f1c3 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:17.573955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-7446cb69-430c-48c1-bd49-ff4f4409f1c3 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1095 microversion: 2.1 time: 0.067350 May 25 07:48:17.573955 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 501/1046] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:17 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1095 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:48:18.567267 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-811feb09-6320-43d9-bc56-9dfa21eb7139 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:18.567888 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-811feb09-6320-43d9-bc56-9dfa21eb7139 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:18.624691 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-811feb09-6320-43d9-bc56-9dfa21eb7139 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:18.632005 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-811feb09-6320-43d9-bc56-9dfa21eb7139 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1095 microversion: 2.1 time: 0.068670 May 25 07:48:18.632583 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 546/1047] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:18 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1095 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:48:19.648817 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-474bbfa7-0b5d-49a1-b06c-e133006efe67 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:19.649394 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-474bbfa7-0b5d-49a1-b06c-e133006efe67 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:19.656443 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-474bbfa7-0b5d-49a1-b06c-e133006efe67 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:19.656925 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-474bbfa7-0b5d-49a1-b06c-e133006efe67 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:19.657697 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-474bbfa7-0b5d-49a1-b06c-e133006efe67 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:19.658137 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-474bbfa7-0b5d-49a1-b06c-e133006efe67 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:19.720000 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-474bbfa7-0b5d-49a1-b06c-e133006efe67 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:19.727597 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-474bbfa7-0b5d-49a1-b06c-e133006efe67 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1145 microversion: 2.1 time: 0.082772 May 25 07:48:19.728158 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 502/1048] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:19 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1145 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:48:20.744294 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-31623e5a-4564-4767-9f94-a0426c89867b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:20.744974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-31623e5a-4564-4767-9f94-a0426c89867b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:20.751520 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-31623e5a-4564-4767-9f94-a0426c89867b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:20.751974 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-31623e5a-4564-4767-9f94-a0426c89867b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:20.752842 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-31623e5a-4564-4767-9f94-a0426c89867b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:20.753282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-31623e5a-4564-4767-9f94-a0426c89867b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:20.814351 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-31623e5a-4564-4767-9f94-a0426c89867b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:20.822841 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-31623e5a-4564-4767-9f94-a0426c89867b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1137 microversion: 2.1 time: 0.082621 May 25 07:48:20.823656 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 547/1049] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:20 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1137 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:48:21.843085 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1a72a1de-e924-4e9e-abc2-7cae8f3d4894 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:21.847247 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-1a72a1de-e924-4e9e-abc2-7cae8f3d4894 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:21.851608 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1a72a1de-e924-4e9e-abc2-7cae8f3d4894 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:21.852075 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1a72a1de-e924-4e9e-abc2-7cae8f3d4894 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:21.852865 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1a72a1de-e924-4e9e-abc2-7cae8f3d4894 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:21.853300 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1a72a1de-e924-4e9e-abc2-7cae8f3d4894 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:21.948331 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1a72a1de-e924-4e9e-abc2-7cae8f3d4894 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:21.955797 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-1a72a1de-e924-4e9e-abc2-7cae8f3d4894 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1211 microversion: 2.1 time: 0.116782 May 25 07:48:21.956362 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 503/1050] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:21 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1211 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:48:22.977982 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-129abe53-65a4-452c-9f3d-fe8351d35d06 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:22.979362 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-129abe53-65a4-452c-9f3d-fe8351d35d06 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:22.988465 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-129abe53-65a4-452c-9f3d-fe8351d35d06 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:22.989373 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-129abe53-65a4-452c-9f3d-fe8351d35d06 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:22.990774 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-129abe53-65a4-452c-9f3d-fe8351d35d06 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:22.992273 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-129abe53-65a4-452c-9f3d-fe8351d35d06 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:23.145255 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-129abe53-65a4-452c-9f3d-fe8351d35d06 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:23.154862 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-129abe53-65a4-452c-9f3d-fe8351d35d06 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1279 microversion: 2.1 time: 0.184527 May 25 07:48:23.155462 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 548/1051] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:22 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1279 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:48:23.317848 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-2db60622-a693-42e6-a281-a15eaed8c88e req-2e5a20d0-714b-480f-afab-c32aac525492 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38054fa1-fe93-4a55-835d-6e533089950a", "tag": "ddaa5409-5e64-4c36-9728-0a60ce9fb2ea"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:48:23.329037 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-2db60622-a693-42e6-a281-a15eaed8c88e req-2e5a20d0-714b-480f-afab-c32aac525492 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:23.329492 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-2db60622-a693-42e6-a281-a15eaed8c88e req-2e5a20d0-714b-480f-afab-c32aac525492 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:23.344106 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-2db60622-a693-42e6-a281-a15eaed8c88e req-2e5a20d0-714b-480f-afab-c32aac525492 service nova] Creating event network-changed:ddaa5409-5e64-4c36-9728-0a60ce9fb2ea for instance 38054fa1-fe93-4a55-835d-6e533089950a on hv-cinder-82549 May 25 07:48:23.352292 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-2db60622-a693-42e6-a281-a15eaed8c88e req-2e5a20d0-714b-480f-afab-c32aac525492 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038005 May 25 07:48:23.352946 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 504/1052] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:48:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:48:24.172520 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8343db80-b9dc-4192-8957-f95b4e2246c5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:24.173148 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-8343db80-b9dc-4192-8957-f95b4e2246c5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:24.174994 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=2 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:48:24.180808 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8343db80-b9dc-4192-8957-f95b4e2246c5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:24.186896 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8343db80-b9dc-4192-8957-f95b4e2246c5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:24.186896 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8343db80-b9dc-4192-8957-f95b4e2246c5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:24.186896 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8343db80-b9dc-4192-8957-f95b4e2246c5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:24.317520 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-8343db80-b9dc-4192-8957-f95b4e2246c5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:24.326121 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-8343db80-b9dc-4192-8957-f95b4e2246c5 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1267 microversion: 2.1 time: 0.157456 May 25 07:48:24.326696 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 549/1053] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:24 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1267 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:48:25.345048 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-1489d253-c488-4f9c-abe2-83642c3ad773 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:25.346425 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-1489d253-c488-4f9c-abe2-83642c3ad773 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:25.353447 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1489d253-c488-4f9c-abe2-83642c3ad773 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:25.353895 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1489d253-c488-4f9c-abe2-83642c3ad773 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:25.354656 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1489d253-c488-4f9c-abe2-83642c3ad773 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:25.355089 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-1489d253-c488-4f9c-abe2-83642c3ad773 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:25.487474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-1489d253-c488-4f9c-abe2-83642c3ad773 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:25.495252 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-1489d253-c488-4f9c-abe2-83642c3ad773 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1267 microversion: 2.1 time: 0.154998 May 25 07:48:25.495818 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 505/1054] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:25 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:48:26.511516 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-5bd47074-14e3-4e05-80b5-464da1af4644 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:26.512142 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-5bd47074-14e3-4e05-80b5-464da1af4644 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:26.518749 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5bd47074-14e3-4e05-80b5-464da1af4644 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:26.519212 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5bd47074-14e3-4e05-80b5-464da1af4644 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:26.519988 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5bd47074-14e3-4e05-80b5-464da1af4644 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:26.520435 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5bd47074-14e3-4e05-80b5-464da1af4644 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:26.570130 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 07:48:26.570727 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Wed May 25 07:48:26 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 07:48:26.652068 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-5bd47074-14e3-4e05-80b5-464da1af4644 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:26.659645 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-5bd47074-14e3-4e05-80b5-464da1af4644 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1267 microversion: 2.1 time: 0.151984 May 25 07:48:26.660434 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 550/1055] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:26 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:48:27.676976 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-aed52aa6-5940-4035-b064-8af9ecaaab44 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:27.677592 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-aed52aa6-5940-4035-b064-8af9ecaaab44 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:27.680020 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=4 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:48:27.684837 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-aed52aa6-5940-4035-b064-8af9ecaaab44 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:27.685291 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-aed52aa6-5940-4035-b064-8af9ecaaab44 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:27.686051 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-aed52aa6-5940-4035-b064-8af9ecaaab44 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:27.686484 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-aed52aa6-5940-4035-b064-8af9ecaaab44 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:27.814431 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-aed52aa6-5940-4035-b064-8af9ecaaab44 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:27.822692 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-aed52aa6-5940-4035-b064-8af9ecaaab44 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1267 microversion: 2.1 time: 0.149808 May 25 07:48:27.823256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 506/1056] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:27 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1267 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:48:28.839381 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-aa33a825-b210-4c80-9b57-51b0667f9a5e tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:28.840003 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-aa33a825-b210-4c80-9b57-51b0667f9a5e tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:28.842389 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=10 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:48:28.847281 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-aa33a825-b210-4c80-9b57-51b0667f9a5e tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:28.847681 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-aa33a825-b210-4c80-9b57-51b0667f9a5e tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:28.848454 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-aa33a825-b210-4c80-9b57-51b0667f9a5e tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:28.848933 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-aa33a825-b210-4c80-9b57-51b0667f9a5e tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:28.976752 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-aa33a825-b210-4c80-9b57-51b0667f9a5e tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:28.984301 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-aa33a825-b210-4c80-9b57-51b0667f9a5e tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1267 microversion: 2.1 time: 0.148935 May 25 07:48:28.984958 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 551/1057] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:28 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1267 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:48:30.001897 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-029e9d62-e03b-4ed4-98cd-afa80df6ee35 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:30.002510 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-029e9d62-e03b-4ed4-98cd-afa80df6ee35 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:30.009854 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-029e9d62-e03b-4ed4-98cd-afa80df6ee35 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:30.010302 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-029e9d62-e03b-4ed4-98cd-afa80df6ee35 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:30.011064 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-029e9d62-e03b-4ed4-98cd-afa80df6ee35 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:30.011500 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-029e9d62-e03b-4ed4-98cd-afa80df6ee35 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:30.145411 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-029e9d62-e03b-4ed4-98cd-afa80df6ee35 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:30.153164 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-029e9d62-e03b-4ed4-98cd-afa80df6ee35 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1267 microversion: 2.1 time: 0.155246 May 25 07:48:30.160951 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 507/1058] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:29 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1267 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:48:31.168819 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-9aee3063-9660-45e6-8d97-b4f5aa84a9ea tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:31.169421 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-9aee3063-9660-45e6-8d97-b4f5aa84a9ea tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:31.175846 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9aee3063-9660-45e6-8d97-b4f5aa84a9ea tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:31.176297 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9aee3063-9660-45e6-8d97-b4f5aa84a9ea tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:31.177102 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9aee3063-9660-45e6-8d97-b4f5aa84a9ea tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:31.177542 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-9aee3063-9660-45e6-8d97-b4f5aa84a9ea tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:31.309971 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-9aee3063-9660-45e6-8d97-b4f5aa84a9ea tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:31.317614 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-9aee3063-9660-45e6-8d97-b4f5aa84a9ea tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1267 microversion: 2.1 time: 0.152681 May 25 07:48:31.318167 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 552/1059] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:31 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1267 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:48:32.336897 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-75631069-842e-4d48-abfb-261750ec92c2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:32.337529 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-75631069-842e-4d48-abfb-261750ec92c2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:32.344065 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-75631069-842e-4d48-abfb-261750ec92c2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:32.344531 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-75631069-842e-4d48-abfb-261750ec92c2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:32.345308 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-75631069-842e-4d48-abfb-261750ec92c2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:32.345736 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-75631069-842e-4d48-abfb-261750ec92c2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:32.478204 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-75631069-842e-4d48-abfb-261750ec92c2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:32.485678 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-75631069-842e-4d48-abfb-261750ec92c2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1267 microversion: 2.1 time: 0.154137 May 25 07:48:32.486175 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 508/1060] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:32 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:48:33.502174 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-3216b015-824a-4753-89cf-7cc76ec8e37d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:33.502790 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-3216b015-824a-4753-89cf-7cc76ec8e37d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:33.509666 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3216b015-824a-4753-89cf-7cc76ec8e37d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:33.510115 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3216b015-824a-4753-89cf-7cc76ec8e37d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:33.510881 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3216b015-824a-4753-89cf-7cc76ec8e37d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:33.511316 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3216b015-824a-4753-89cf-7cc76ec8e37d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:33.643415 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-3216b015-824a-4753-89cf-7cc76ec8e37d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:33.652261 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-3216b015-824a-4753-89cf-7cc76ec8e37d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1267 microversion: 2.1 time: 0.153978 May 25 07:48:33.652949 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 553/1061] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:33 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:48:33.838226 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-72587974-3e23-4b56-af6c-6c8c68f123e6 req-fd5ecbf1-e0ff-4cbd-929c-1c2a4ab3f636 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38054fa1-fe93-4a55-835d-6e533089950a", "name": "network-vif-plugged", "status": "completed", "tag": "ddaa5409-5e64-4c36-9728-0a60ce9fb2ea"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:48:33.846346 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-72587974-3e23-4b56-af6c-6c8c68f123e6 req-fd5ecbf1-e0ff-4cbd-929c-1c2a4ab3f636 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:33.846786 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-72587974-3e23-4b56-af6c-6c8c68f123e6 req-fd5ecbf1-e0ff-4cbd-929c-1c2a4ab3f636 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:33.860462 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-72587974-3e23-4b56-af6c-6c8c68f123e6 req-fd5ecbf1-e0ff-4cbd-929c-1c2a4ab3f636 service nova] Creating event network-vif-plugged:ddaa5409-5e64-4c36-9728-0a60ce9fb2ea for instance 38054fa1-fe93-4a55-835d-6e533089950a on hv-cinder-82549 May 25 07:48:33.865865 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-72587974-3e23-4b56-af6c-6c8c68f123e6 req-fd5ecbf1-e0ff-4cbd-929c-1c2a4ab3f636 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.090135 May 25 07:48:33.866460 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 509/1062] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:48:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:48:34.669648 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-34e3724b-41cb-4a7a-8250-9a4246783877 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:34.670274 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-34e3724b-41cb-4a7a-8250-9a4246783877 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:34.676799 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-34e3724b-41cb-4a7a-8250-9a4246783877 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:34.677256 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-34e3724b-41cb-4a7a-8250-9a4246783877 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:34.678029 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-34e3724b-41cb-4a7a-8250-9a4246783877 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:34.678474 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-34e3724b-41cb-4a7a-8250-9a4246783877 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:34.811253 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-34e3724b-41cb-4a7a-8250-9a4246783877 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:34.818684 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-34e3724b-41cb-4a7a-8250-9a4246783877 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1267 microversion: 2.1 time: 0.152963 May 25 07:48:34.819253 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 554/1063] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:34 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1267 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:48:35.837063 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-3fd67d3b-5043-430b-aeed-30caef319e91 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:35.837760 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-3fd67d3b-5043-430b-aeed-30caef319e91 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:35.844363 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3fd67d3b-5043-430b-aeed-30caef319e91 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:35.844888 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3fd67d3b-5043-430b-aeed-30caef319e91 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:35.845606 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3fd67d3b-5043-430b-aeed-30caef319e91 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:35.846041 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-3fd67d3b-5043-430b-aeed-30caef319e91 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:35.979116 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-3fd67d3b-5043-430b-aeed-30caef319e91 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:35.986540 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-3fd67d3b-5043-430b-aeed-30caef319e91 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1454 microversion: 2.1 time: 0.154365 May 25 07:48:35.987111 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 510/1064] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:35 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1454 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:48:36.003065 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-e1ee93b0-603d-4247-bded-89e7c2c56c45 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:48:36.003692 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-e1ee93b0-603d-4247-bded-89e7c2c56c45 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:48:36.010803 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e1ee93b0-603d-4247-bded-89e7c2c56c45 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:36.011263 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e1ee93b0-603d-4247-bded-89e7c2c56c45 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:36.012039 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e1ee93b0-603d-4247-bded-89e7c2c56c45 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:36.012505 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-e1ee93b0-603d-4247-bded-89e7c2c56c45 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:36.159512 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-e1ee93b0-603d-4247-bded-89e7c2c56c45 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:48:36.167599 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-e1ee93b0-603d-4247-bded-89e7c2c56c45 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1454 microversion: 2.1 time: 0.168387 May 25 07:48:36.168193 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 555/1065] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:48:35 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1454 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:48:38.190021 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-18d341b1-aed6-4e0c-8fce-6aaba80aed2a req-259c564f-2f99-4d5a-9db1-3ae85f40c939 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38054fa1-fe93-4a55-835d-6e533089950a", "tag": "ddaa5409-5e64-4c36-9728-0a60ce9fb2ea"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:48:38.199479 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-18d341b1-aed6-4e0c-8fce-6aaba80aed2a req-259c564f-2f99-4d5a-9db1-3ae85f40c939 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:48:38.201494 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-18d341b1-aed6-4e0c-8fce-6aaba80aed2a req-259c564f-2f99-4d5a-9db1-3ae85f40c939 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:48:38.210929 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-18d341b1-aed6-4e0c-8fce-6aaba80aed2a req-259c564f-2f99-4d5a-9db1-3ae85f40c939 service nova] Creating event network-changed:ddaa5409-5e64-4c36-9728-0a60ce9fb2ea for instance 38054fa1-fe93-4a55-835d-6e533089950a on hv-cinder-82549 May 25 07:48:38.216259 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-18d341b1-aed6-4e0c-8fce-6aaba80aed2a req-259c564f-2f99-4d5a-9db1-3ae85f40c939 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030254 May 25 07:48:38.216873 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 511/1066] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:48:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:50:01.667676 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 07:50:01.668218 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Wed May 25 07:50:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 07:50:18.869645 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:50:18.870644 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=76 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:50:18.874618 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-6a22a9ae-ebb5-463e-8601-117abec7d0b3 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-611484788", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1927951084", "security_groups": [{"name": "tempest-secgroup-smoke-2067050148"}], "block_device_mapping_v2": [{"uuid": "0fc73c65-c2df-4f70-a73e-6a2fcdf3935b", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "9bcd68e9-0045-4b34-8142-bf28d91642fb"}]}} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:50:18.985840 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.network.neutron [None req-6a22a9ae-ebb5-463e-8601-117abec7d0b3 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] validate_networks() for [('9bcd68e9-0045-4b34-8142-bf28d91642fb', None, None, None, None, None)] {{(pid=124675) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} May 25 07:50:19.343138 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-6a22a9ae-ebb5-463e-8601-117abec7d0b3 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Flavor limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} May 25 07:50:19.343518 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-6a22a9ae-ebb5-463e-8601-117abec7d0b3 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Image limits 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} May 25 07:50:19.344030 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-6a22a9ae-ebb5-463e-8601-117abec7d0b3 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Flavor pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} May 25 07:50:19.344755 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-6a22a9ae-ebb5-463e-8601-117abec7d0b3 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Image pref 0:0:0 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} May 25 07:50:19.345179 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.virt.hardware [None req-6a22a9ae-ebb5-463e-8601-117abec7d0b3 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=124675) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} May 25 07:50:19.355626 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6a22a9ae-ebb5-463e-8601-117abec7d0b3 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:19.356111 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6a22a9ae-ebb5-463e-8601-117abec7d0b3 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:19.356942 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6a22a9ae-ebb5-463e-8601-117abec7d0b3 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:19.357383 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-6a22a9ae-ebb5-463e-8601-117abec7d0b3 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:19.377721 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-6a22a9ae-ebb5-463e-8601-117abec7d0b3 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Getting quotas for project f5e67d0f06be415794efd436655904b3. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:393}} May 25 07:50:19.381494 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.quota [None req-6a22a9ae-ebb5-463e-8601-117abec7d0b3 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Getting quotas for user d3d92c0c69cf470e8aecb57e79e5a7fe and project f5e67d0f06be415794efd436655904b3. Resources: {'cores', 'instances', 'ram'} {{(pid=124675) _get_quotas /opt/stack/nova/nova/quota.py:383}} May 25 07:50:19.438245 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-6a22a9ae-ebb5-463e-8601-117abec7d0b3 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Going to run 1 instances... {{(pid=124675) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} May 25 07:50:19.440155 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-6a22a9ae-ebb5-463e-8601-117abec7d0b3 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0fc73c65-c2df-4f70-a73e-6a2fcdf3935b',volume_size=None,volume_type=None)] {{(pid=124675) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} May 25 07:50:19.851518 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-6a22a9ae-ebb5-463e-8601-117abec7d0b3 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.983418 May 25 07:50:19.852095 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 556/1067] 10.222.0.24 () {60 vars in 1146 bytes} [Wed May 25 07:50:18 2022] POST /compute/v2.1/servers => generated 406 bytes in 985 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) May 25 07:50:19.861043 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:50:19.865553 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:50:19.866111 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-711a35d9-abd1-4b1d-8e12-0e76836cfc9a tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:50:19.866839 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-711a35d9-abd1-4b1d-8e12-0e76836cfc9a tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:50:19.920172 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-711a35d9-abd1-4b1d-8e12-0e76836cfc9a tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:50:19.927493 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-711a35d9-abd1-4b1d-8e12-0e76836cfc9a tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 200 len: 1094 microversion: 2.1 time: 0.069196 May 25 07:50:19.928059 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 512/1068] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:50:19 2022] GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:50:20.945054 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-54f01243-45ef-4dd6-86b8-061cee32f51b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:50:20.948330 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-54f01243-45ef-4dd6-86b8-061cee32f51b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:50:20.954270 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-54f01243-45ef-4dd6-86b8-061cee32f51b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:20.954729 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-54f01243-45ef-4dd6-86b8-061cee32f51b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:20.955642 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-54f01243-45ef-4dd6-86b8-061cee32f51b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:20.956086 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-54f01243-45ef-4dd6-86b8-061cee32f51b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:21.019136 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-54f01243-45ef-4dd6-86b8-061cee32f51b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:50:21.026572 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-54f01243-45ef-4dd6-86b8-061cee32f51b tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 200 len: 1136 microversion: 2.1 time: 0.085420 May 25 07:50:21.027120 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 557/1069] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:50:20 2022] GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 1136 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:50:21.132282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 07:50:21.132552 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Wed May 25 07:50:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 07:50:22.043635 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c1cb581c-24be-46a8-bd7b-de9f4d394c20 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:50:22.044276 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c1cb581c-24be-46a8-bd7b-de9f4d394c20 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:50:22.052927 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c1cb581c-24be-46a8-bd7b-de9f4d394c20 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:22.053385 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c1cb581c-24be-46a8-bd7b-de9f4d394c20 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:22.054162 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c1cb581c-24be-46a8-bd7b-de9f4d394c20 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:22.054605 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c1cb581c-24be-46a8-bd7b-de9f4d394c20 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:22.125684 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-c1cb581c-24be-46a8-bd7b-de9f4d394c20 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:50:22.133830 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c1cb581c-24be-46a8-bd7b-de9f4d394c20 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 200 len: 1200 microversion: 2.1 time: 0.094326 May 25 07:50:22.134401 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 513/1070] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:50:22 2022] GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 1200 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:50:23.156221 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8a8482f9-b010-4846-aa58-7468ff9ca0ef tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:50:23.156817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-8a8482f9-b010-4846-aa58-7468ff9ca0ef tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:50:23.164538 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8a8482f9-b010-4846-aa58-7468ff9ca0ef tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:23.164994 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8a8482f9-b010-4846-aa58-7468ff9ca0ef tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:23.165843 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8a8482f9-b010-4846-aa58-7468ff9ca0ef tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:23.166283 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8a8482f9-b010-4846-aa58-7468ff9ca0ef tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:23.304183 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-8a8482f9-b010-4846-aa58-7468ff9ca0ef tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:50:23.312775 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-8a8482f9-b010-4846-aa58-7468ff9ca0ef tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 200 len: 1278 microversion: 2.1 time: 0.160431 May 25 07:50:23.313345 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 558/1071] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:50:23 2022] GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 1278 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:50:23.670923 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-baeb9046-1d0d-4934-ad68-fb047eeb9081 req-62b06c0b-4db1-4397-b0ba-e44556502128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea50859-33c4-4b54-a47f-b7c1dbc4347b", "tag": "767207cc-9ef9-4297-a7aa-2399282f8f48"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:50:23.681210 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-baeb9046-1d0d-4934-ad68-fb047eeb9081 req-62b06c0b-4db1-4397-b0ba-e44556502128 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:23.681973 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-baeb9046-1d0d-4934-ad68-fb047eeb9081 req-62b06c0b-4db1-4397-b0ba-e44556502128 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:23.693804 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-baeb9046-1d0d-4934-ad68-fb047eeb9081 req-62b06c0b-4db1-4397-b0ba-e44556502128 service nova] Creating event network-changed:767207cc-9ef9-4297-a7aa-2399282f8f48 for instance 5ea50859-33c4-4b54-a47f-b7c1dbc4347b on hv-cinder-82549 May 25 07:50:23.699135 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-baeb9046-1d0d-4934-ad68-fb047eeb9081 req-62b06c0b-4db1-4397-b0ba-e44556502128 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035170 May 25 07:50:23.699828 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 514/1072] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:50:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:50:24.331966 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-412d98f8-aa40-4756-951a-8f688812f2e2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:50:24.332620 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-412d98f8-aa40-4756-951a-8f688812f2e2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:50:24.339209 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-412d98f8-aa40-4756-951a-8f688812f2e2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:24.339664 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-412d98f8-aa40-4756-951a-8f688812f2e2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:24.340436 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-412d98f8-aa40-4756-951a-8f688812f2e2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:24.340904 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-412d98f8-aa40-4756-951a-8f688812f2e2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:24.470723 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-412d98f8-aa40-4756-951a-8f688812f2e2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:50:24.478091 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-412d98f8-aa40-4756-951a-8f688812f2e2 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 200 len: 1266 microversion: 2.1 time: 0.150870 May 25 07:50:24.478659 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 559/1073] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:50:24 2022] GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:50:25.496445 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-f6915068-41ff-453b-8e53-b89db5e600d7 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:50:25.497162 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-f6915068-41ff-453b-8e53-b89db5e600d7 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:50:25.504107 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f6915068-41ff-453b-8e53-b89db5e600d7 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:25.504587 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f6915068-41ff-453b-8e53-b89db5e600d7 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:25.505351 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f6915068-41ff-453b-8e53-b89db5e600d7 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:25.505785 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f6915068-41ff-453b-8e53-b89db5e600d7 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:25.638390 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-f6915068-41ff-453b-8e53-b89db5e600d7 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:50:25.646230 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-f6915068-41ff-453b-8e53-b89db5e600d7 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 200 len: 1266 microversion: 2.1 time: 0.154747 May 25 07:50:25.646793 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 515/1074] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:50:25 2022] GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:50:26.662992 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b99dc7f9-f00d-4c66-8e98-5078e368a60c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:50:26.663613 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b99dc7f9-f00d-4c66-8e98-5078e368a60c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:50:26.670082 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b99dc7f9-f00d-4c66-8e98-5078e368a60c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:26.670534 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b99dc7f9-f00d-4c66-8e98-5078e368a60c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:26.671297 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b99dc7f9-f00d-4c66-8e98-5078e368a60c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:26.671734 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b99dc7f9-f00d-4c66-8e98-5078e368a60c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:26.797892 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b99dc7f9-f00d-4c66-8e98-5078e368a60c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:50:26.805343 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b99dc7f9-f00d-4c66-8e98-5078e368a60c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 200 len: 1266 microversion: 2.1 time: 0.146321 May 25 07:50:26.805903 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 560/1075] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:50:26 2022] GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 1266 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:50:27.821939 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-8deb8f92-aaee-4e57-9bd7-41fd2c2ccff8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:50:27.822548 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-8deb8f92-aaee-4e57-9bd7-41fd2c2ccff8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:50:27.828784 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8deb8f92-aaee-4e57-9bd7-41fd2c2ccff8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:27.829241 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8deb8f92-aaee-4e57-9bd7-41fd2c2ccff8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:27.830006 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8deb8f92-aaee-4e57-9bd7-41fd2c2ccff8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:27.831060 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-8deb8f92-aaee-4e57-9bd7-41fd2c2ccff8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:27.957434 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-8deb8f92-aaee-4e57-9bd7-41fd2c2ccff8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:50:27.964796 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-8deb8f92-aaee-4e57-9bd7-41fd2c2ccff8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 200 len: 1266 microversion: 2.1 time: 0.146754 May 25 07:50:27.965360 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 516/1076] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:50:27 2022] GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 1266 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:50:28.982032 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-2b87a31e-605d-4f89-b3a8-f00b2f4489ff tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:50:28.982662 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-2b87a31e-605d-4f89-b3a8-f00b2f4489ff tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:50:28.990101 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2b87a31e-605d-4f89-b3a8-f00b2f4489ff tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:28.990567 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2b87a31e-605d-4f89-b3a8-f00b2f4489ff tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:28.991347 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2b87a31e-605d-4f89-b3a8-f00b2f4489ff tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:28.991794 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-2b87a31e-605d-4f89-b3a8-f00b2f4489ff tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:29.125104 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-2b87a31e-605d-4f89-b3a8-f00b2f4489ff tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:50:29.132711 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-2b87a31e-605d-4f89-b3a8-f00b2f4489ff tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 200 len: 1266 microversion: 2.1 time: 0.154601 May 25 07:50:29.133277 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 561/1077] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:50:28 2022] GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:50:30.149935 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-ef92304c-9869-42f6-92c9-34888cc8000f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:50:30.150542 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-ef92304c-9869-42f6-92c9-34888cc8000f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:50:30.153001 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell0:SELECT=2 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:50:30.157702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ef92304c-9869-42f6-92c9-34888cc8000f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:30.158147 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ef92304c-9869-42f6-92c9-34888cc8000f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:30.158904 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ef92304c-9869-42f6-92c9-34888cc8000f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:30.159340 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ef92304c-9869-42f6-92c9-34888cc8000f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:30.290198 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-ef92304c-9869-42f6-92c9-34888cc8000f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:50:30.297621 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-ef92304c-9869-42f6-92c9-34888cc8000f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 200 len: 1266 microversion: 2.1 time: 0.151564 May 25 07:50:30.298186 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 517/1078] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:50:30 2022] GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:50:31.316695 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-3af5f764-6191-473e-8294-19fbf2cedb90 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:50:31.317523 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-3af5f764-6191-473e-8294-19fbf2cedb90 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:50:31.319366 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=2 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:50:31.320035 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell0:SELECT=6 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:50:31.325342 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3af5f764-6191-473e-8294-19fbf2cedb90 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:31.325845 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3af5f764-6191-473e-8294-19fbf2cedb90 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:31.326621 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3af5f764-6191-473e-8294-19fbf2cedb90 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:31.327069 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-3af5f764-6191-473e-8294-19fbf2cedb90 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:31.456283 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-3af5f764-6191-473e-8294-19fbf2cedb90 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:50:31.463956 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-3af5f764-6191-473e-8294-19fbf2cedb90 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 200 len: 1266 microversion: 2.1 time: 0.151875 May 25 07:50:31.464537 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 562/1079] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:50:31 2022] GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:50:32.479684 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-ece89dd8-b097-4bd9-a60d-c0be7895fa2f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:50:32.480381 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-ece89dd8-b097-4bd9-a60d-c0be7895fa2f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:50:32.486870 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ece89dd8-b097-4bd9-a60d-c0be7895fa2f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:32.487315 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ece89dd8-b097-4bd9-a60d-c0be7895fa2f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:32.488305 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ece89dd8-b097-4bd9-a60d-c0be7895fa2f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:32.488766 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-ece89dd8-b097-4bd9-a60d-c0be7895fa2f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:32.624191 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-ece89dd8-b097-4bd9-a60d-c0be7895fa2f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:50:32.632591 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-ece89dd8-b097-4bd9-a60d-c0be7895fa2f tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 200 len: 1266 microversion: 2.1 time: 0.156691 May 25 07:50:32.633167 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 518/1080] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:50:32 2022] GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:50:33.649657 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-8afb8f5a-ecf0-41c0-b53d-def7a546983c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:50:33.650306 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-8afb8f5a-ecf0-41c0-b53d-def7a546983c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:50:33.656817 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8afb8f5a-ecf0-41c0-b53d-def7a546983c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:33.657272 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8afb8f5a-ecf0-41c0-b53d-def7a546983c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:33.658038 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8afb8f5a-ecf0-41c0-b53d-def7a546983c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:33.658480 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-8afb8f5a-ecf0-41c0-b53d-def7a546983c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:33.789017 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-8afb8f5a-ecf0-41c0-b53d-def7a546983c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:50:33.796374 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-8afb8f5a-ecf0-41c0-b53d-def7a546983c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 200 len: 1266 microversion: 2.1 time: 0.150615 May 25 07:50:33.796979 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 563/1081] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:50:33 2022] GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:50:34.335481 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [req-6ea7920b-d60b-4fce-800b-0ae120b73037 req-a308425a-4f20-4a3e-89fd-733312b1c91f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea50859-33c4-4b54-a47f-b7c1dbc4347b", "name": "network-vif-plugged", "status": "completed", "tag": "767207cc-9ef9-4297-a7aa-2399282f8f48"}]} {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:50:34.343946 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-6ea7920b-d60b-4fce-800b-0ae120b73037 req-a308425a-4f20-4a3e-89fd-733312b1c91f service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:34.344328 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [req-6ea7920b-d60b-4fce-800b-0ae120b73037 req-a308425a-4f20-4a3e-89fd-733312b1c91f service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:34.355289 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.compute.server_external_events [req-6ea7920b-d60b-4fce-800b-0ae120b73037 req-a308425a-4f20-4a3e-89fd-733312b1c91f service nova] Creating event network-vif-plugged:767207cc-9ef9-4297-a7aa-2399282f8f48 for instance 5ea50859-33c4-4b54-a47f-b7c1dbc4347b on hv-cinder-82549 May 25 07:50:34.360567 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [req-6ea7920b-d60b-4fce-800b-0ae120b73037 req-a308425a-4f20-4a3e-89fd-733312b1c91f service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029962 May 25 07:50:34.361167 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 519/1082] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:50:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:50:34.812929 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-1a0418c0-72d7-4e7d-ba3e-0c26e0debcb8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:50:34.813547 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-1a0418c0-72d7-4e7d-ba3e-0c26e0debcb8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:50:34.820264 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1a0418c0-72d7-4e7d-ba3e-0c26e0debcb8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:34.820744 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1a0418c0-72d7-4e7d-ba3e-0c26e0debcb8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:34.821511 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1a0418c0-72d7-4e7d-ba3e-0c26e0debcb8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:34.822009 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-1a0418c0-72d7-4e7d-ba3e-0c26e0debcb8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:34.957620 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-1a0418c0-72d7-4e7d-ba3e-0c26e0debcb8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:50:34.965094 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-1a0418c0-72d7-4e7d-ba3e-0c26e0debcb8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 200 len: 1266 microversion: 2.1 time: 0.156037 May 25 07:50:34.965665 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 564/1083] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:50:34 2022] GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:50:35.983148 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-9e415eb9-c808-4a73-be8f-94bcf5144cfb tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:50:35.983841 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-9e415eb9-c808-4a73-be8f-94bcf5144cfb tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:50:35.990534 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9e415eb9-c808-4a73-be8f-94bcf5144cfb tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:35.990976 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9e415eb9-c808-4a73-be8f-94bcf5144cfb tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:35.991753 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9e415eb9-c808-4a73-be8f-94bcf5144cfb tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:35.992193 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-9e415eb9-c808-4a73-be8f-94bcf5144cfb tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:36.129250 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-9e415eb9-c808-4a73-be8f-94bcf5144cfb tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:50:36.136748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-9e415eb9-c808-4a73-be8f-94bcf5144cfb tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 200 len: 1266 microversion: 2.1 time: 0.158321 May 25 07:50:36.137310 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 520/1084] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:50:35 2022] GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 1266 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:50:37.154741 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-b76b6d66-a27c-487a-918a-28aaddd2a617 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:50:37.155356 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-b76b6d66-a27c-487a-918a-28aaddd2a617 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:50:37.162666 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b76b6d66-a27c-487a-918a-28aaddd2a617 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:37.163115 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b76b6d66-a27c-487a-918a-28aaddd2a617 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:37.163984 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b76b6d66-a27c-487a-918a-28aaddd2a617 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:37.164419 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-b76b6d66-a27c-487a-918a-28aaddd2a617 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:37.296650 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-b76b6d66-a27c-487a-918a-28aaddd2a617 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:50:37.304774 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-b76b6d66-a27c-487a-918a-28aaddd2a617 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 200 len: 1453 microversion: 2.1 time: 0.154117 May 25 07:50:37.305344 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 565/1085] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:50:37 2022] GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:50:37.320564 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-2360a7c6-d4be-4a93-9fbb-f221f7d01b3d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:50:37.321117 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-2360a7c6-d4be-4a93-9fbb-f221f7d01b3d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:50:37.327509 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2360a7c6-d4be-4a93-9fbb-f221f7d01b3d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:37.327942 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2360a7c6-d4be-4a93-9fbb-f221f7d01b3d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:37.328738 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2360a7c6-d4be-4a93-9fbb-f221f7d01b3d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:37.329170 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2360a7c6-d4be-4a93-9fbb-f221f7d01b3d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:37.459275 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-2360a7c6-d4be-4a93-9fbb-f221f7d01b3d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:50:37.468068 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-2360a7c6-d4be-4a93-9fbb-f221f7d01b3d tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 200 len: 1453 microversion: 2.1 time: 0.151489 May 25 07:50:37.468666 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 521/1086] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:50:37 2022] GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:50:39.726998 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-6a56c2e1-faf1-40f2-974d-bdd36e67ce7c req-3a4dad6b-d21a-4cbf-a501-ef06f4965863 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea50859-33c4-4b54-a47f-b7c1dbc4347b", "tag": "767207cc-9ef9-4297-a7aa-2399282f8f48"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:50:39.734986 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-6a56c2e1-faf1-40f2-974d-bdd36e67ce7c req-3a4dad6b-d21a-4cbf-a501-ef06f4965863 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:50:39.735447 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-6a56c2e1-faf1-40f2-974d-bdd36e67ce7c req-3a4dad6b-d21a-4cbf-a501-ef06f4965863 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:50:39.746994 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-6a56c2e1-faf1-40f2-974d-bdd36e67ce7c req-3a4dad6b-d21a-4cbf-a501-ef06f4965863 service nova] Creating event network-changed:767207cc-9ef9-4297-a7aa-2399282f8f48 for instance 5ea50859-33c4-4b54-a47f-b7c1dbc4347b on hv-cinder-82549 May 25 07:50:39.752995 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-6a56c2e1-faf1-40f2-974d-bdd36e67ce7c req-3a4dad6b-d21a-4cbf-a501-ef06f4965863 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.119367 May 25 07:50:39.754222 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 566/1087] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:50:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:51:34.042017 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 07:51:34.042637 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Wed May 25 07:51:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 07:51:46.578450 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 07:51:46.579093 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Wed May 25 07:51:46 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 07:52:08.568335 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_api:SELECT=35,nova_api:INSERT=3 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:52:08.568917 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-2ca77660-9dfb-4730-abdb-b86c53ef3703 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:52:08.569368 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG dbcounter [-] [124675] Writing DB stats nova_cell1:SELECT=58 {{(pid=124675) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:52:08.569523 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-2ca77660-9dfb-4730-abdb-b86c53ef3703 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:52:08.571935 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_api:SELECT=22 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:52:08.572699 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG dbcounter [-] [124674] Writing DB stats nova_cell1:SELECT=46 {{(pid=124674) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 25 07:52:08.574279 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-5404e157-c4ed-4f3a-9966-f4f5cf9418a1 req-c605e7e2-fb90-48b2-94a2-0b40eb7eef9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5ea50859-33c4-4b54-a47f-b7c1dbc4347b", "tag": "767207cc-9ef9-4297-a7aa-2399282f8f48"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:52:08.579237 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2ca77660-9dfb-4730-abdb-b86c53ef3703 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:08.583702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2ca77660-9dfb-4730-abdb-b86c53ef3703 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:08.583702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2ca77660-9dfb-4730-abdb-b86c53ef3703 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:08.583702 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-2ca77660-9dfb-4730-abdb-b86c53ef3703 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:08.584012 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-5404e157-c4ed-4f3a-9966-f4f5cf9418a1 req-c605e7e2-fb90-48b2-94a2-0b40eb7eef9b service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:08.584655 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-5404e157-c4ed-4f3a-9966-f4f5cf9418a1 req-c605e7e2-fb90-48b2-94a2-0b40eb7eef9b service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:08.605577 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-5404e157-c4ed-4f3a-9966-f4f5cf9418a1 req-c605e7e2-fb90-48b2-94a2-0b40eb7eef9b service nova] Creating event network-changed:767207cc-9ef9-4297-a7aa-2399282f8f48 for instance 5ea50859-33c4-4b54-a47f-b7c1dbc4347b on hv-cinder-82549 May 25 07:52:08.611522 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-5404e157-c4ed-4f3a-9966-f4f5cf9418a1 req-c605e7e2-fb90-48b2-94a2-0b40eb7eef9b service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045133 May 25 07:52:08.611809 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-2ca77660-9dfb-4730-abdb-b86c53ef3703 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Going to try to terminate instance {{(pid=124674) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:52:08.612910 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 567/1088] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:52:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:52:08.889560 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-2ca77660-9dfb-4730-abdb-b86c53ef3703 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "DELETE /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 204 len: 0 microversion: 2.1 time: 0.325550 May 25 07:52:08.891256 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 522/1089] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:52:08 2022] DELETE /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 07:52:08.901490 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-aa0fada4-35b9-4ee0-9eca-967837f7ac00 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:52:08.902199 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-aa0fada4-35b9-4ee0-9eca-967837f7ac00 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:52:08.909067 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-aa0fada4-35b9-4ee0-9eca-967837f7ac00 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:08.909858 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-aa0fada4-35b9-4ee0-9eca-967837f7ac00 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:08.910658 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-aa0fada4-35b9-4ee0-9eca-967837f7ac00 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:08.911113 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-aa0fada4-35b9-4ee0-9eca-967837f7ac00 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:09.120256 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-aa0fada4-35b9-4ee0-9eca-967837f7ac00 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:52:09.128432 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-aa0fada4-35b9-4ee0-9eca-967837f7ac00 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 200 len: 1578 microversion: 2.1 time: 0.233368 May 25 07:52:09.129039 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 568/1090] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:52:08 2022] GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 1578 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:52:10.146681 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-4e17bb55-eff2-4ebf-86a2-1e944209d284 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:52:10.150156 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-4e17bb55-eff2-4ebf-86a2-1e944209d284 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:52:10.155242 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4e17bb55-eff2-4ebf-86a2-1e944209d284 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:10.155740 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4e17bb55-eff2-4ebf-86a2-1e944209d284 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:10.156562 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4e17bb55-eff2-4ebf-86a2-1e944209d284 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:10.156959 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-4e17bb55-eff2-4ebf-86a2-1e944209d284 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:10.357357 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-4e17bb55-eff2-4ebf-86a2-1e944209d284 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:52:10.366999 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-4e17bb55-eff2-4ebf-86a2-1e944209d284 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 200 len: 1578 microversion: 2.1 time: 0.225065 May 25 07:52:10.367562 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 523/1091] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:52:10 2022] GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 1578 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:52:11.064977 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-2456b660-25c0-4ddd-a92d-3f3536739cea req-95ddcad8-87c2-4153-98b0-3fbdd7885957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5ea50859-33c4-4b54-a47f-b7c1dbc4347b", "name": "network-vif-deleted", "tag": "767207cc-9ef9-4297-a7aa-2399282f8f48"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:52:11.073282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-2456b660-25c0-4ddd-a92d-3f3536739cea req-95ddcad8-87c2-4153-98b0-3fbdd7885957 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:11.073733 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-2456b660-25c0-4ddd-a92d-3f3536739cea req-95ddcad8-87c2-4153-98b0-3fbdd7885957 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:11.084513 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-2456b660-25c0-4ddd-a92d-3f3536739cea req-95ddcad8-87c2-4153-98b0-3fbdd7885957 service nova] Creating event network-vif-deleted:767207cc-9ef9-4297-a7aa-2399282f8f48 for instance 5ea50859-33c4-4b54-a47f-b7c1dbc4347b on hv-cinder-82549 May 25 07:52:11.089409 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-2456b660-25c0-4ddd-a92d-3f3536739cea req-95ddcad8-87c2-4153-98b0-3fbdd7885957 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028882 May 25 07:52:11.089988 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 569/1092] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:52:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) May 25 07:52:11.384463 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-f2e79bf8-69c1-45ae-a5fb-5822cef843b9 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:52:11.385197 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-f2e79bf8-69c1-45ae-a5fb-5822cef843b9 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:52:11.392250 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f2e79bf8-69c1-45ae-a5fb-5822cef843b9 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:11.392734 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f2e79bf8-69c1-45ae-a5fb-5822cef843b9 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:11.393513 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f2e79bf8-69c1-45ae-a5fb-5822cef843b9 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:11.394205 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-f2e79bf8-69c1-45ae-a5fb-5822cef843b9 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:11.459767 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-f2e79bf8-69c1-45ae-a5fb-5822cef843b9 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:52:11.468443 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-f2e79bf8-69c1-45ae-a5fb-5822cef843b9 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 200 len: 1225 microversion: 2.1 time: 0.087894 May 25 07:52:11.469262 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 524/1093] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:52:11 2022] GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 1225 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:52:12.487260 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-76404717-0f34-41dc-9efb-a4dfbcb78755 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:52:12.488054 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-76404717-0f34-41dc-9efb-a4dfbcb78755 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 5ea50859-33c4-4b54-a47f-b7c1dbc4347b] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:52:12.494284 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-76404717-0f34-41dc-9efb-a4dfbcb78755 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:12.494738 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-76404717-0f34-41dc-9efb-a4dfbcb78755 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:12.495502 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-76404717-0f34-41dc-9efb-a4dfbcb78755 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:12.495946 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-76404717-0f34-41dc-9efb-a4dfbcb78755 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:12.509396 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-76404717-0f34-41dc-9efb-a4dfbcb78755 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] HTTP exception thrown: Instance 5ea50859-33c4-4b54-a47f-b7c1dbc4347b could not be found. May 25 07:52:12.514886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-76404717-0f34-41dc-9efb-a4dfbcb78755 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Request method failure captured: May 25 07:52:12.514886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b HTTP/1.1 May 25 07:52:12.514886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:52:12.514886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:52:12.514886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:52:12.514886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:52:12.514886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:52:12.514886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:52:12.514886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:52:12.514886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:52:12.514886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijd57bFC1IiSdTlbYYsvoilbc5KwdrCZKOoMVu8rRzkpnes7s45pWmLmoCnoybBzG8bjsBfz2IUwlx4dHm-RTT4B22FVpWSU2wDDfwSW5jOju8smTl0uc7SaaDHs4CVYphiOCsAQNpSRxwUedljW86iB3aivZs6jCes4CTX8e1SrsSO4 May 25 07:52:12.514886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:52:12.514886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:52:12.514886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:52:12.514886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:52:12.514886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:52:12.514886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:52:12.514886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: f5e67d0f06be415794efd436655904b3 May 25 07:52:12.514886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-TestVolumeBootPattern-1147907125 May 25 07:52:12.514886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:52:12.514886 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:52:12.516661 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f5e67d0f06be415794efd436655904b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/f5e67d0f06be415794efd436655904b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_f5e67d0f06be415794efd436655904b3", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f5e67d0f06be415794efd436655904b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:52:12.516661 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-TestVolumeBootPattern-1147907125 May 25 07:52:12.516661 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: f5e67d0f06be415794efd436655904b3 May 25 07:52:12.516661 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-TestVolumeBootPattern-1147907125 May 25 07:52:12.516661 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-TestVolumeBootPattern-1147907125-project May 25 07:52:12.516661 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:52:12.516661 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:52:12.516661 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: d3d92c0c69cf470e8aecb57e79e5a7fe May 25 07:52:12.516661 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-TestVolumeBootPattern-1147907125-project May 25 07:52:12.516661 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:52:12.516661 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance 5ea50859-33c4-4b54-a47f-b7c1dbc4347b could not be found. May 25 07:52:12.516661 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': '5ea50859-33c4-4b54-a47f-b7c1dbc4347b'} May 25 07:52:12.517667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:52:12.517667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:52:12.517667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:52:12.517667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:52:12.517667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:52:12.517667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:52:12.517667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:52:12.517667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:52:12.517667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:52:12.517667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:52:12.517667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5ea50859-33c4-4b54-a47f-b7c1dbc4347b could not be found. May 25 07:52:12.517667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:52:12.517667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:52:12.517667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:52:12.517667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:52:12.517667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:52:12.517667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:52:12.517667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:52:12.517667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:52:12.517667 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:52:12.519282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:52:12.519282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:52:12.519282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:52:12.519282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:52:12.519282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:52:12.519282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:52:12.519282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:52:12.519282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5ea50859-33c4-4b54-a47f-b7c1dbc4347b could not be found. May 25 07:52:12.519282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:52:12.519282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:52:12.519282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:52:12.519282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:52:12.519282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:52:12.519282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:52:12.519282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:52:12.519282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:52:12.519282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5ea50859-33c4-4b54-a47f-b7c1dbc4347b could not be found. May 25 07:52:12.519282 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:52:12.521535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-76404717-0f34-41dc-9efb-a4dfbcb78755 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Returning 404 to user: Instance 5ea50859-33c4-4b54-a47f-b7c1dbc4347b could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:52:12.521535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-76404717-0f34-41dc-9efb-a4dfbcb78755 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b" status: 404 len: 111 microversion: 2.1 time: 0.029995 May 25 07:52:12.521535 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 570/1094] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:52:12 2022] GET /compute/v2.1/servers/5ea50859-33c4-4b54-a47f-b7c1dbc4347b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:52:15.777998 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-c0ba8e93-7eb2-4f93-9618-0a7636bff77c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:52:15.778528 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c0ba8e93-7eb2-4f93-9618-0a7636bff77c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:52:15.780577 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-bbe168a2-8db9-4125-b84f-8705560dbae7 req-90e1838d-35bc-460e-bbbf-8a5fea341820 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "38054fa1-fe93-4a55-835d-6e533089950a", "tag": "ddaa5409-5e64-4c36-9728-0a60ce9fb2ea"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:52:15.785592 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c0ba8e93-7eb2-4f93-9618-0a7636bff77c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:15.786319 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c0ba8e93-7eb2-4f93-9618-0a7636bff77c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:15.787241 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c0ba8e93-7eb2-4f93-9618-0a7636bff77c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:15.787752 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-c0ba8e93-7eb2-4f93-9618-0a7636bff77c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:15.789087 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-bbe168a2-8db9-4125-b84f-8705560dbae7 req-90e1838d-35bc-460e-bbbf-8a5fea341820 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:15.789738 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-bbe168a2-8db9-4125-b84f-8705560dbae7 req-90e1838d-35bc-460e-bbbf-8a5fea341820 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:15.802545 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-bbe168a2-8db9-4125-b84f-8705560dbae7 req-90e1838d-35bc-460e-bbbf-8a5fea341820 service nova] Creating event network-changed:ddaa5409-5e64-4c36-9728-0a60ce9fb2ea for instance 38054fa1-fe93-4a55-835d-6e533089950a on hv-cinder-82549 May 25 07:52:15.807583 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-bbe168a2-8db9-4125-b84f-8705560dbae7 req-90e1838d-35bc-460e-bbbf-8a5fea341820 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031554 May 25 07:52:15.808394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 571/1095] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:52:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:52:15.815350 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-c0ba8e93-7eb2-4f93-9618-0a7636bff77c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Going to try to terminate instance {{(pid=124674) delete /opt/stack/nova/nova/compute/api.py:2664}} May 25 07:52:16.111420 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-c0ba8e93-7eb2-4f93-9618-0a7636bff77c tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "DELETE /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 204 len: 0 microversion: 2.1 time: 0.331984 May 25 07:52:16.111420 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 525/1096] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:52:15 2022] DELETE /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) May 25 07:52:16.116999 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-5d127fb0-1ae9-4d17-a451-7d2da1a76c7e tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:52:16.117712 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-5d127fb0-1ae9-4d17-a451-7d2da1a76c7e tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:52:16.124469 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5d127fb0-1ae9-4d17-a451-7d2da1a76c7e tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:16.124961 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5d127fb0-1ae9-4d17-a451-7d2da1a76c7e tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:16.125739 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5d127fb0-1ae9-4d17-a451-7d2da1a76c7e tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:16.126686 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-5d127fb0-1ae9-4d17-a451-7d2da1a76c7e tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:16.259510 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.policy [None req-5d127fb0-1ae9-4d17-a451-7d2da1a76c7e tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124675) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:52:16.267676 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-5d127fb0-1ae9-4d17-a451-7d2da1a76c7e tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1578 microversion: 2.1 time: 0.154822 May 25 07:52:16.268252 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 572/1097] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:52:16 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1578 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:52:17.286282 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-5269c606-8423-4cbf-93ab-9ee49eb844be tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:52:17.286982 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-5269c606-8423-4cbf-93ab-9ee49eb844be tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:52:17.293474 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5269c606-8423-4cbf-93ab-9ee49eb844be tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:17.297499 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5269c606-8423-4cbf-93ab-9ee49eb844be tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:17.297499 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5269c606-8423-4cbf-93ab-9ee49eb844be tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:17.297499 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-5269c606-8423-4cbf-93ab-9ee49eb844be tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:17.496978 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-5269c606-8423-4cbf-93ab-9ee49eb844be tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:52:17.504583 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-5269c606-8423-4cbf-93ab-9ee49eb844be tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1578 microversion: 2.1 time: 0.222516 May 25 07:52:17.505150 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 526/1098] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:52:17 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1578 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) May 25 07:52:18.202052 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [req-58bc4fdd-7aed-4ef4-a4e8-ce77d910c400 req-cc59410f-2c91-4358-a718-13e885243554 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "38054fa1-fe93-4a55-835d-6e533089950a", "name": "network-vif-deleted", "tag": "ddaa5409-5e64-4c36-9728-0a60ce9fb2ea"}]} {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} May 25 07:52:18.210670 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-58bc4fdd-7aed-4ef4-a4e8-ce77d910c400 req-cc59410f-2c91-4358-a718-13e885243554 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:18.211189 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [req-58bc4fdd-7aed-4ef4-a4e8-ce77d910c400 req-cc59410f-2c91-4358-a718-13e885243554 service nova] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:18.222813 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.compute.server_external_events [req-58bc4fdd-7aed-4ef4-a4e8-ce77d910c400 req-cc59410f-2c91-4358-a718-13e885243554 service nova] Creating event network-vif-deleted:ddaa5409-5e64-4c36-9728-0a60ce9fb2ea for instance 38054fa1-fe93-4a55-835d-6e533089950a on hv-cinder-82549 May 25 07:52:18.228640 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [req-58bc4fdd-7aed-4ef4-a4e8-ce77d910c400 req-cc59410f-2c91-4358-a718-13e885243554 service nova] 10.222.0.24 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029962 May 25 07:52:18.228640 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 573/1099] 10.222.0.24 () {64 vars in 1317 bytes} [Wed May 25 07:52:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) May 25 07:52:18.522073 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-793cea64-88ce-4ac9-81cd-7d5ca800182a tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:52:18.522809 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-793cea64-88ce-4ac9-81cd-7d5ca800182a tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:52:18.532577 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-793cea64-88ce-4ac9-81cd-7d5ca800182a tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:18.533038 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-793cea64-88ce-4ac9-81cd-7d5ca800182a tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:18.533827 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-793cea64-88ce-4ac9-81cd-7d5ca800182a tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:18.534263 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-793cea64-88ce-4ac9-81cd-7d5ca800182a tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:18.632434 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.policy [None req-793cea64-88ce-4ac9-81cd-7d5ca800182a tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd3d92c0c69cf470e8aecb57e79e5a7fe', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f5e67d0f06be415794efd436655904b3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=124674) authorize /opt/stack/nova/nova/policy.py:199}} May 25 07:52:18.651487 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-793cea64-88ce-4ac9-81cd-7d5ca800182a tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 200 len: 1226 microversion: 2.1 time: 0.133691 May 25 07:52:18.652405 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 527/1100] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:52:18 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 1226 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) May 25 07:52:19.670593 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-21483cc6-7616-456e-9ddd-71c313420af8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:52:19.671486 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-21483cc6-7616-456e-9ddd-71c313420af8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 38054fa1-fe93-4a55-835d-6e533089950a] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:52:19.677685 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-21483cc6-7616-456e-9ddd-71c313420af8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:19.678138 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-21483cc6-7616-456e-9ddd-71c313420af8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:19.678899 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-21483cc6-7616-456e-9ddd-71c313420af8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:19.679339 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-21483cc6-7616-456e-9ddd-71c313420af8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:19.693188 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-21483cc6-7616-456e-9ddd-71c313420af8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] HTTP exception thrown: Instance 38054fa1-fe93-4a55-835d-6e533089950a could not be found. May 25 07:52:19.696041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-21483cc6-7616-456e-9ddd-71c313420af8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Request method failure captured: May 25 07:52:19.696041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a HTTP/1.1 May 25 07:52:19.696041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:52:19.696041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:52:19.696041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:52:19.696041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:52:19.696041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:52:19.696041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:52:19.696041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:52:19.696041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:52:19.696041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijd57bFC1IiSdTlbYYsvoilbc5KwdrCZKOoMVu8rRzkpnes7s45pWmLmoCnoybBzG8bjsBfz2IUwlx4dHm-RTT4B22FVpWSU2wDDfwSW5jOju8smTl0uc7SaaDHs4CVYphiOCsAQNpSRxwUedljW86iB3aivZs6jCes4CTX8e1SrsSO4 May 25 07:52:19.696041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:52:19.696041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:52:19.696041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:52:19.696041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:52:19.696041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:52:19.696041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:52:19.696041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: f5e67d0f06be415794efd436655904b3 May 25 07:52:19.696041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-TestVolumeBootPattern-1147907125 May 25 07:52:19.696041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:52:19.696041 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:52:19.697813 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f5e67d0f06be415794efd436655904b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/f5e67d0f06be415794efd436655904b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_f5e67d0f06be415794efd436655904b3", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f5e67d0f06be415794efd436655904b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:52:19.697813 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-TestVolumeBootPattern-1147907125 May 25 07:52:19.697813 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: f5e67d0f06be415794efd436655904b3 May 25 07:52:19.697813 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-TestVolumeBootPattern-1147907125 May 25 07:52:19.697813 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-TestVolumeBootPattern-1147907125-project May 25 07:52:19.697813 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:52:19.697813 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:52:19.697813 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: d3d92c0c69cf470e8aecb57e79e5a7fe May 25 07:52:19.697813 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-TestVolumeBootPattern-1147907125-project May 25 07:52:19.697813 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:52:19.697813 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance 38054fa1-fe93-4a55-835d-6e533089950a could not be found. May 25 07:52:19.697813 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': '38054fa1-fe93-4a55-835d-6e533089950a'} May 25 07:52:19.698689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:52:19.698689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:52:19.698689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:52:19.698689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:52:19.698689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:52:19.698689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:52:19.698689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:52:19.698689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:52:19.698689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:52:19.698689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:52:19.698689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 38054fa1-fe93-4a55-835d-6e533089950a could not be found. May 25 07:52:19.698689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:52:19.698689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:52:19.698689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:52:19.698689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:52:19.698689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:52:19.698689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:52:19.698689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:52:19.698689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:52:19.698689 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:52:19.700154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:52:19.700154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:52:19.700154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:52:19.700154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:52:19.700154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:52:19.700154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:52:19.700154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:52:19.700154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 38054fa1-fe93-4a55-835d-6e533089950a could not be found. May 25 07:52:19.700154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:52:19.700154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:52:19.700154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:52:19.700154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:52:19.700154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:52:19.700154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:52:19.700154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:52:19.700154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:52:19.700154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 38054fa1-fe93-4a55-835d-6e533089950a could not be found. May 25 07:52:19.700154 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:52:19.701983 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-21483cc6-7616-456e-9ddd-71c313420af8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Returning 404 to user: Instance 38054fa1-fe93-4a55-835d-6e533089950a could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:52:19.701983 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-21483cc6-7616-456e-9ddd-71c313420af8 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a" status: 404 len: 111 microversion: 2.1 time: 0.031142 May 25 07:52:19.701983 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 574/1101] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:52:19 2022] GET /compute/v2.1/servers/38054fa1-fe93-4a55-835d-6e533089950a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:52:20.198158 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-649aa760-db0f-4ee7-924a-7436dc9bb636 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:52:20.198650 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.compute.api [None req-649aa760-db0f-4ee7-924a-7436dc9bb636 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124674) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:52:20.205816 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-649aa760-db0f-4ee7-924a-7436dc9bb636 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:20.206267 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-649aa760-db0f-4ee7-924a-7436dc9bb636 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:20.207024 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-649aa760-db0f-4ee7-924a-7436dc9bb636 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:20.207456 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG oslo_concurrency.lockutils [None req-649aa760-db0f-4ee7-924a-7436dc9bb636 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124674) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:20.221433 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.wsgi [None req-649aa760-db0f-4ee7-924a-7436dc9bb636 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] HTTP exception thrown: Instance 684d03bd-f960-4032-8299-19dc8fa3029e could not be found. May 25 07:52:20.223159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-649aa760-db0f-4ee7-924a-7436dc9bb636 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Request method failure captured: May 25 07:52:20.223159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: request: DELETE /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e HTTP/1.1 May 25 07:52:20.223159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept: application/json May 25 07:52:20.223159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Accept-Encoding: identity May 25 07:52:20.223159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Connection: close May 25 07:52:20.223159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Length: 0 May 25 07:52:20.223159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Content-Type: application/json May 25 07:52:20.223159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Host: 10.222.0.24 May 25 07:52:20.223159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Openstack-System-Scope: None May 25 07:52:20.223159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: User-Agent: python-urllib3/1.26.9 May 25 07:52:20.223159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Auth-Token: gAAAAABijd57bFC1IiSdTlbYYsvoilbc5KwdrCZKOoMVu8rRzkpnes7s45pWmLmoCnoybBzG8bjsBfz2IUwlx4dHm-RTT4B22FVpWSU2wDDfwSW5jOju8smTl0uc7SaaDHs4CVYphiOCsAQNpSRxwUedljW86iB3aivZs6jCes4CTX8e1SrsSO4 May 25 07:52:20.223159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Id: None May 25 07:52:20.223159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Domain-Name: None May 25 07:52:20.223159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Identity-Status: Confirmed May 25 07:52:20.223159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Is-Admin-Project: True May 25 07:52:20.223159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Id: default May 25 07:52:20.223159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Domain-Name: Default May 25 07:52:20.223159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Id: f5e67d0f06be415794efd436655904b3 May 25 07:52:20.223159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Project-Name: tempest-TestVolumeBootPattern-1147907125 May 25 07:52:20.223159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Role: member,reader May 25 07:52:20.223159 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Roles: member,reader May 25 07:52:20.224905 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f5e67d0f06be415794efd436655904b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/f5e67d0f06be415794efd436655904b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_f5e67d0f06be415794efd436655904b3", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f5e67d0f06be415794efd436655904b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:52:20.224905 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant: tempest-TestVolumeBootPattern-1147907125 May 25 07:52:20.224905 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Id: f5e67d0f06be415794efd436655904b3 May 25 07:52:20.224905 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-Tenant-Name: tempest-TestVolumeBootPattern-1147907125 May 25 07:52:20.224905 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User: tempest-TestVolumeBootPattern-1147907125-project May 25 07:52:20.224905 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Id: default May 25 07:52:20.224905 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Domain-Name: Default May 25 07:52:20.224905 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Id: d3d92c0c69cf470e8aecb57e79e5a7fe May 25 07:52:20.224905 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: X-User-Name: tempest-TestVolumeBootPattern-1147907125-project May 25 07:52:20.224905 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: method: > May 25 07:52:20.224905 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: exception: Instance 684d03bd-f960-4032-8299-19dc8fa3029e could not be found. May 25 07:52:20.224905 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: action_args: {'id': '684d03bd-f960-4032-8299-19dc8fa3029e'} May 25 07:52:20.226053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:52:20.226053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:52:20.226053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:52:20.226053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:52:20.226053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:52:20.226053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:52:20.226053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:52:20.226053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:52:20.226053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:52:20.226053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:52:20.226053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 684d03bd-f960-4032-8299-19dc8fa3029e could not be found. May 25 07:52:20.226053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:52:20.226053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:52:20.226053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:52:20.226053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:52:20.226053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:52:20.226053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:52:20.226053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:52:20.226053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:52:20.226053 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:52:20.227668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:52:20.227668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete May 25 07:52:20.227668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) May 25 07:52:20.227668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete May 25 07:52:20.227668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) May 25 07:52:20.227668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:52:20.227668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:52:20.227668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:52:20.227668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:52:20.227668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 684d03bd-f960-4032-8299-19dc8fa3029e could not be found. May 25 07:52:20.227668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:52:20.227668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:52:20.227668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:52:20.227668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:52:20.227668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:52:20.227668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:52:20.227668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:52:20.227668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:52:20.227668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 684d03bd-f960-4032-8299-19dc8fa3029e could not be found. May 25 07:52:20.227668 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: ERROR nova.api.openstack.wsgi May 25 07:52:20.229800 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-649aa760-db0f-4ee7-924a-7436dc9bb636 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Returning 404 to user: Instance 684d03bd-f960-4032-8299-19dc8fa3029e could not be found. {{(pid=124674) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:52:20.229800 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-649aa760-db0f-4ee7-924a-7436dc9bb636 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "DELETE /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 404 len: 111 microversion: 2.1 time: 0.030304 May 25 07:52:20.229800 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 528/1102] 10.222.0.24 () {58 vars in 1238 bytes} [Wed May 25 07:52:20 2022] DELETE /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:52:20.233328 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-243282c3-68e0-49ce-8950-b80374de3997 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '>' {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:52:20.233949 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.compute.api [None req-243282c3-68e0-49ce-8950-b80374de3997 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] [instance: 684d03bd-f960-4032-8299-19dc8fa3029e] Fetching instance by UUID {{(pid=124675) get /opt/stack/nova/nova/compute/api.py:2920}} May 25 07:52:20.239856 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-243282c3-68e0-49ce-8950-b80374de3997 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:20.240305 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-243282c3-68e0-49ce-8950-b80374de3997 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:20.241138 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-243282c3-68e0-49ce-8950-b80374de3997 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} May 25 07:52:20.241574 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG oslo_concurrency.lockutils [None req-243282c3-68e0-49ce-8950-b80374de3997 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Lock "b54eaccb-ae13-4b47-bdce-eca4e8d593ce" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=124675) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} May 25 07:52:20.256674 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.wsgi [None req-243282c3-68e0-49ce-8950-b80374de3997 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] HTTP exception thrown: Instance 684d03bd-f960-4032-8299-19dc8fa3029e could not be found. May 25 07:52:20.258372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-243282c3-68e0-49ce-8950-b80374de3997 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Request method failure captured: May 25 07:52:20.258372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: request: GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e HTTP/1.1 May 25 07:52:20.258372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept: application/json May 25 07:52:20.258372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Accept-Encoding: identity May 25 07:52:20.258372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Connection: close May 25 07:52:20.258372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Length: 0 May 25 07:52:20.258372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Content-Type: application/json May 25 07:52:20.258372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Host: 10.222.0.24 May 25 07:52:20.258372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Openstack-System-Scope: None May 25 07:52:20.258372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: User-Agent: python-urllib3/1.26.9 May 25 07:52:20.258372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Auth-Token: gAAAAABijd57bFC1IiSdTlbYYsvoilbc5KwdrCZKOoMVu8rRzkpnes7s45pWmLmoCnoybBzG8bjsBfz2IUwlx4dHm-RTT4B22FVpWSU2wDDfwSW5jOju8smTl0uc7SaaDHs4CVYphiOCsAQNpSRxwUedljW86iB3aivZs6jCes4CTX8e1SrsSO4 May 25 07:52:20.258372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Id: None May 25 07:52:20.258372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Domain-Name: None May 25 07:52:20.258372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Identity-Status: Confirmed May 25 07:52:20.258372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Is-Admin-Project: True May 25 07:52:20.258372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Id: default May 25 07:52:20.258372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Domain-Name: Default May 25 07:52:20.258372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Id: f5e67d0f06be415794efd436655904b3 May 25 07:52:20.258372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Project-Name: tempest-TestVolumeBootPattern-1147907125 May 25 07:52:20.258372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Role: member,reader May 25 07:52:20.258372 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Roles: member,reader May 25 07:52:20.260340 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Service-Catalog: [{"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f5e67d0f06be415794efd436655904b3"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2.1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/compute/v2/f5e67d0f06be415794efd436655904b3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:9696/"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24:8080/v1/AUTH_f5e67d0f06be415794efd436655904b3", "adminURL": "http://10.222.0.24:8080"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/volume/v3/f5e67d0f06be415794efd436655904b3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/placement"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.24/identity"}]}] May 25 07:52:20.260340 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant: tempest-TestVolumeBootPattern-1147907125 May 25 07:52:20.260340 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Id: f5e67d0f06be415794efd436655904b3 May 25 07:52:20.260340 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-Tenant-Name: tempest-TestVolumeBootPattern-1147907125 May 25 07:52:20.260340 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User: tempest-TestVolumeBootPattern-1147907125-project May 25 07:52:20.260340 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Id: default May 25 07:52:20.260340 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Domain-Name: Default May 25 07:52:20.260340 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Id: d3d92c0c69cf470e8aecb57e79e5a7fe May 25 07:52:20.260340 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: X-User-Name: tempest-TestVolumeBootPattern-1147907125-project May 25 07:52:20.260340 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: method: > May 25 07:52:20.260340 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: exception: Instance 684d03bd-f960-4032-8299-19dc8fa3029e could not be found. May 25 07:52:20.260340 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: action_args: {'id': '684d03bd-f960-4032-8299-19dc8fa3029e'} May 25 07:52:20.261394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: {{(pid=124675) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} May 25 07:52:20.261394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:52:20.261394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance May 25 07:52:20.261394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, May 25 07:52:20.261394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get May 25 07:52:20.261394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, May 25 07:52:20.261394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance May 25 07:52:20.261394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, May 25 07:52:20.261394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell May 25 07:52:20.261394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) May 25 07:52:20.261394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 684d03bd-f960-4032-8299-19dc8fa3029e could not be found. May 25 07:52:20.261394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:52:20.261394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:52:20.261394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:52:20.261394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:52:20.261394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:52:20.261394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:52:20.261394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch May 25 07:52:20.261394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) May 25 07:52:20.261394 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped May 25 07:52:20.262767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) May 25 07:52:20.262767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show May 25 07:52:20.262767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = self._get_server( May 25 07:52:20.262767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server May 25 07:52:20.262767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, May 25 07:52:20.262767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance May 25 07:52:20.262767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) May 25 07:52:20.262767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 684d03bd-f960-4032-8299-19dc8fa3029e could not be found. May 25 07:52:20.262767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:52:20.262767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: May 25 07:52:20.262767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:52:20.262767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): May 25 07:52:20.262767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack May 25 07:52:20.262767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) May 25 07:52:20.262767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ May 25 07:52:20.262767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) May 25 07:52:20.262767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 684d03bd-f960-4032-8299-19dc8fa3029e could not be found. May 25 07:52:20.262767 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: ERROR nova.api.openstack.wsgi May 25 07:52:20.264964 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: DEBUG nova.api.openstack.wsgi [None req-243282c3-68e0-49ce-8950-b80374de3997 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Returning 404 to user: Instance 684d03bd-f960-4032-8299-19dc8fa3029e could not be found. {{(pid=124675) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} May 25 07:52:20.264964 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO nova.api.openstack.requestlog [None req-243282c3-68e0-49ce-8950-b80374de3997 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e" status: 404 len: 111 microversion: 2.1 time: 0.030495 May 25 07:52:20.264964 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: [pid: 124675|app: 0|req: 575/1103] 10.222.0.24 () {58 vars in 1235 bytes} [Wed May 25 07:52:20 2022] GET /compute/v2.1/servers/684d03bd-f960-4032-8299-19dc8fa3029e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) May 25 07:52:21.773415 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: DEBUG nova.api.openstack.wsgi [None req-830063aa-25b3-49e4-aa75-b50267a51a12 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] Calling method '.version_select at 0x7fc8645c4af0>' {{(pid=124674) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} May 25 07:52:21.850160 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO nova.api.openstack.requestlog [None req-830063aa-25b3-49e4-aa75-b50267a51a12 tempest-TestVolumeBootPattern-1147907125 tempest-TestVolumeBootPattern-1147907125-project] 10.222.0.24 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1927951084" status: 202 len: 0 microversion: 2.1 time: 0.080488 May 25 07:52:21.850748 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: [pid: 124674|app: 0|req: 529/1104] 10.222.0.24 () {58 vars in 1262 bytes} [Wed May 25 07:52:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1927951084 => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) May 25 07:53:21.676322 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 07:53:21.676878 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Wed May 25 07:53:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 07:53:27.117307 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 07:53:27.118028 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Wed May 25 07:53:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 07:54:54.050620 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 07:54:54.051232 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Wed May 25 07:54:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 07:55:06.591022 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 07:55:06.591681 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Wed May 25 07:55:06 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 07:55:21.142392 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 07:55:21.142981 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Wed May 25 07:55:21 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 07:55:27.752530 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 07:55:27.753148 dv-cinder-825492-15-iscsi devstack@n-api.service[124674]: Wed May 25 07:55:27 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 07:56:41.684532 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 07:56:41.685053 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Wed May 25 07:56:41 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! May 25 07:56:47.125875 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer May 25 07:56:47.126726 dv-cinder-825492-15-iscsi devstack@n-api.service[124675]: Wed May 25 07:56:47 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!